Lead Developer/Engineer role at Merkle in Bengaluru, responsible for designing, implementing, and deploying enterprise data solutions using cutting-edge cloud-based technologies. Must have 5+ years of experience with programming languages, strong database fundamentals, and cloud-based technologies. Required skills include workflow orchestration, Big Data ETL, and data structure understanding. Desired skills include Snowflake data warehouse, AWS services, and data processing workflow systems.
We are looking for a talented Data Engineer with big data processing experience to join our Agile development team in building products to support Merkle’s people based marketing vision using the latest data and cloud technologies. You will work with a team of passionate, experienced, nimble, and goal-oriented engineers that are solving complex problems and critical data analysis and reporting features. You will embrace change, and rapidly build, test, and scale solutions that drive incremental business value for our customers and partners. We’re looking for smart, enthusiastic, driven individuals who are eager to contribute to our world class solutions.
Job Description:
Key Responsibilities
- Design, implement, and deploy enterprise data solutions using cutting-edge cloud-based technologies
- Follow Agile methodologies to release iterative feature sets very rapidly
- Research and introduce new solutions and technologies to the project and stakeholders, provide technical guidance and suggest improvements in development
- Work independently, without guidance, with broader overview on the project
- Coordinate with other teams as part of a larger data-sharing system
- Employ software development best practices such as automated testing, peer code reviews, continuous integration, and continuous delivery
- Translate business requirements and develop technical specifications
- Communicate clearly and document processes
- Perform quality assurance and testing of your work
- Contribute to a collaborative, positive, stimulating, and enjoyable environment for your development team
Qualifications
- Bachelor’s degree in Computer Science, Engineering, Information Systems or equivalent experience
- Must have 5+ years of work experience with programming languages and object-oriented design (Python preferred)
- Must have strong database fundamentals including SQL, relational and non-relational data models and schema designs, and understanding of database performance implications
- Must have understanding of cloud-based technologies (AWS, GCP or Azure, AWS preferred)
- Must have experience leveraging automated tests for code validation and test-driven development
- Must have experience building and deploying products using continuous integration principles
- Must have working knowledge of software engineering and development methodologies, techniques, and tools, including Issue Tracking (like JIRA), code repositories (like Git, Bitbucket) and the Software Development Lifecycle
Required Skills:
- Experience building workflow orchestration, logging, error handling and automated testing utilizing Python and the Pytest framework
- Understanding of “Big Data” ETL methodologies and managing large scale data sets
- Strong understanding of data structures, algorithms, and distributed systems
Desired Skills:
- Experience with Snowflake data warehouse including scheduled tasks, table streams and JavaScript stored procedures
- Experience with AWS services (such as S3, EC2, RDS, EMR, Lambda or SNS/SQS)
- Experience with data processing workflow systems (Apache Nifi, Talend or Airflow)
- Experience with creating reports, dashboards and visualizations (Tableau preferred)
Location:
DGS India - Pune - Baner M- Agile
Brand:
Merkle
Time Type:
Full time
Contract Type:
Permanent
Top Skills
Python
SQL
Similar Jobs
Healthtech • Logistics • Pharmaceutical
The Lead Data Engineer will lead the design and development of scalable analytic data engineering products, focus on optimizing data processes, mentor team members, and collaborate with stakeholders to drive insights from data. The role involves implementing data ingestion frameworks, ensuring data quality, and maintaining standards for data visualization and reporting.
Top Skills:
Machine Learning
Healthtech • Logistics • Pharmaceutical
As a Lead Data Engineer, you will manage the Azure cloud environment, design and implement scalable solutions, analyze and improve operational processes, engage in Proof of Concepts, migrate infrastructure to cloud solutions, and develop infrastructure as code with robotic processes while ensuring data protection policies are in place.
Top Skills:
Azure CliAzure PowershellC#GitAzurePythonTerraform
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Sr. Data Engineer will work on projects involving PySpark and Scala with a focus on data analysis and debugging. They will utilize their skills in Spark, GIT, and familiar CICD tools to manage the Big Data Application Life Cycle while ensuring efficient incident management using Control-M and Service Now.
Top Skills:
PysparkScalaSpark
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
