Designs, builds, and maintains scalable ETL pipelines connecting Salesforce with Snowflake and other data systems. The role manages Salesforce APIs and bulk data loading, writes and optimizes SQL and Python for data transformation, conducts Git-based code reviews, and monitors pipeline performance, availability, and data integrity.
Summary
We are seeking an experienced Data Engineer to join our IT Services division. In this pivotal role, you will design, build, and maintain robust data pipelines that facilitate seamless information flow across our Salesforce ecosystem and data warehouse. You will be instrumental in ensuring data integrity, optimizing ETL processes, and enabling data-driven decision-making through the implementation of scalable architectures using Snowflake, Python, and SQL. This position offers the opportunity to work with cutting-edge technologies while driving efficiency in our data loading and transformation workflows.
Responsibilities
- Architect and develop efficient ETL solutions for bulk data loading operations, specifically tailored for Salesforce environments.
- Integrate and manage Salesforce APIs to ensure accurate and timely data synchronization between external systems and the CRM.
- Utilize specialized Salesforce data loading tools to handle large-scale data migration and maintenance tasks.
- Write, review, and optimize complex SQL queries and Python scripts to support data processing and analysis needs.
- Collaborate with development teams to conduct code reviews, ensuring adherence to best practices and version control standards using Git.
- Monitor and troubleshoot data pipelines to maintain high availability and performance within the Snowflake platform.
- Implement secure and scalable data loading strategies to support business growth and operational requirements.
Requirements
Requirements:
- Possess 6 to 8 years of professional experience in data engineering, with a strong focus on IT Services.
- Demonstrate deep proficiency with Salesforce APIs and dedicated data loading utilities.
- Show proven expertise in designing and executing ETL processes and bulk data loading strategies.
- Be highly skilled in SQL and Python for data manipulation, transformation, and automation.
- Have hands-on experience working with Snowflake as a primary data warehouse solution.
- Exhibit strong competency in version control systems, specifically Git, including the ability to perform thorough code reviews.
- Hold a competitive salary expectation within the range of ₹12-14 LPA.
Similar Jobs
Information Technology
Builds and maintains scalable batch and streaming data pipelines, data models, data flows, APIs, and integrations across on-premises and cloud environments. Translates business requirements into technical designs, code, testing, deployment, and maintenance tasks. Ensures data quality, governance, accessibility, and readiness for reporting, analytics, and AI/ML use cases. The role also requires advanced QA testing and automation expertise using tools such as Pytest, Selenium, Playwright, or similar platforms, along with P&C insurance and Guidewire experience.
Top Skills:
AgileAi/MlAPIsAzure DevopsBig DataBlue PrismCloud ComputingGitGuidewireJIRANlpNon-Relational DatabasesPlaywrightPytestPythonRelational DatabasesRpaSeleniumSnowflakeSQL
Information Technology
Acquires, curates, models, and publishes data across on-premises and cloud environments. Develops and maintains batch and streaming pipelines, API integrations, data models, data flows, and data access methods. Translates business requirements into technical solutions, performs data cleansing and validation, supports reporting and AI/ML use cases, and applies data governance practices. Works on basic to mid-sized projects with coaching and guidance.
Top Skills:
Ai/Ml ToolsAWSAws GlueData WarehousingDimensional ModelingNatural Language ProcessingNon-Relational DatabasesPysparkPythonRelational DatabasesRest ApisSQL
Information Technology
Acquires, curates, models, and publishes data across on-premises and cloud environments. Designs and maintains batch and streaming pipelines, APIs, data products, data flows, and models supporting reporting, dashboards, analytics, and data science. Translates business requirements into technical implementations, applies governance and data quality practices, and develops scalable solutions using SQL, DBT, Python, PySpark, Snowflake, Power BI, and related technologies.
Top Skills:
Ai/MlAPIsDbtInformaticaNatural Language ProcessingPower BIPysparkPythonShell ScriptingSnowflakeSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
