Role: Data Engineer
Experience: 8+ Years
Location: Hyderabad, Bengaluru, Chennai, Pune, Ahmedabad and Noida
What You'll Do
Provide the organization’s data consumers high quality data sets by data curation, consolidation, and manipulation from a wide variety of large scale (terabyte and growing) sources.
Build first-class data products and ETL processes that interact with terabytes of data on leading platforms such as Snowflake and BigQuery.
Partner with our Analytics, Product, CRM, and Marketing teams.
Be responsible for the data pipelines’ SLA and dependency management.
Write technical documentation for data solutions, and present at design reviews.
Solve data pipeline failure events and implement anomaly detection.
Work with various teams from Data Science, Product owners, to Marketing and software engineers on data solutions and solving technical challenges.
Mentor junior members of the team
What We Seek
Education and Work Experience
Bachelor’s degree in Computer Science or related field
8+ Years experience in commercial data engineering or software development.
Tech Experience
Experience with Big Data technologies such as Snowflake, Databricks, PySpark
Expert level skills in writing and optimizing complex SQL; advanced data exploration skills with proven record of querying and analyzing large datasets.
Solid experience developing complex ETL processes from concept to implementation to deployment and operations, including SLA definition, performance measurements and monitoring.
Hands-on knowledge of the modern AWS Data Ecosystem, including AWS S3
Experience with relational databases such as Postgres, and with programming languages such as Python and/or Java
Knowledge of cloud data warehouse concepts.
Experience in building and operating data pipelines and products in compliance with the data mesh philosophy would be beneficial. Demonstrated efficiency in treating data, including data lineage, data quality, data observability and data discoverability.
Communication/people skills
Excellent verbal and written communication skills. Ability to convey key insights from complex analyses in summarized business terms to non-technical stakeholders and also ability to effectively communicate with other technical teams.
Strong interpersonal skills and the ability to work in a fast-paced and dynamic environment.
Ability to make progress on projects independently and enthusiasm for solving difficult problems.
