Job Summary
Responsible for designing, building and overseeing the deployment and operation of technology architecture, solutions and software to capture, manage, store and utilize structured and unstructured data from internal and external sources. Establishes and builds processes and structures based on business and technical requirements to channel data from multiple inputs, route appropriately and store using any combination of distributed (cloud) structures, local databases, and other applicable storage forms as required. Develops technical tools and programming that leverage artificial intelligence, machine learning and big-data techniques to cleanse, organize and transform data and to maintain, defend and update data structures and integrity on an automated basis. Creates and establishes design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements. Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs. Work with data modelers/analysts to understand the business problems they are trying to solve then create or augment data assets to feed their analysis. Has in-depth experience, knowledge and skills in own discipline. Usually determines own work priorities. Acts as resource for colleagues with less experience.Job Description
ABOUT THE ROLE:
The Data Engineer 3 for the Data Products Engineering Team will be building data pipelines to land, profile and store multiple internal & external datasets and build applications that surface this data to support our business partners’ strategic decision making. We are an AWS shop that uses opensource technologies like Scala, Python, Pandas, Spark, Iceberg, Postgres, and BI tools like Tableau and MicroStrategy. We work in a very agile environment, where product specifications are flexible and often change rapidly over time. We are seeking people who are comfortable with ambiguity, can drive towards clarity and define execution plans.
Contributor to the overall Data Product roadmap by working closely with our business partners to understand their challenges and develop analytical tools to help drive business decisions
Must understand the basics of relational data modeling and be able to clearly articulate the reasons to use non-relational systems in our architecture.
Interface with other technology teams to leverage cloud-native data engineering principles to deliver high quality data faster.
Foster a DevOps culture and participate in development sprints, retrospectives, releases, and deployments.
Build and manage relationships to optimize value creation from ideation to delivery.
REQUIREMENTS:
Bachelor's degree in engineering, Computer Science, Information Systems, or related field with 5-8 years of relevant experience.
2+ years of hands-on experience in design, build, test, orchestrate, deploy large scale Scala Spark ETL Jobs.
2+ years of experience with AWS technologies such as S3, Athena, Lambdas, EMR or EMR Serverless or similar.
1+ years of Experience in Data Modeling, Data architecture, Data Quality, Metadata, ETL or Data Warehouse methodologies and technologies.
Experience in OpenTable Format such as Iceberg or similar, Datawarehouse such as Snowflake or similar, MySQL or Postgres or similar is a plus.
Strong problem-solving skills.
General understanding of SDLC and Agile Methodologies
General understanding of Test-Driven Development and CI/CD
General understanding of cloud data engineering design patterns, data storage principles, and related use cases.
Desired Characteristics
Lifelong Learner – technology is constantly evolving, and you love continuously learning new ways to upskill yourself.
Positive Ownership Attitude – You foster a positive ownership mindset by taking pride in all that you do; holding yourself and partners accountable to productive outcomes.
Action-oriented – You are discovering novel solutions and regularly showing actionable results.
Communicator – You have excellent verbal and written skills with the ability to communicate ideas effectively across all levels of the organization, to both technical and non-technical audiences
Partnership – You display ethical behavior, integrity, respect and build trust among colleagues.
We believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality—to help support you physically, financially and emotionally through the big milestones and in your everyday life.
Please visit the benefits summary on our careers site for more details.
Education
Bachelor's DegreeWhile possessing the stated degree is preferred, Comcast also may consider applicants who hold some combination of coursework and experience, or who have extensive related professional experience.Certifications (if applicable)
Relevant Work Experience
5-7 YearsComcast is an equal opportunity workplace. We will consider all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, veteran status, genetic information, or any other basis protected by applicable law.
