Design and optimize data infrastructure and pipelines, develop ETL processes, and provide mentorship to junior engineers while collaborating with data analysts.
BlackStone eIT is on the lookout for a Senior Data Engineer to join our innovative team. In this role, you will be responsible for the design, development, and optimization of our data infrastructure. You'll play a crucial part in supporting data analytics initiatives across the organization by ensuring we have robust and scalable data pipelines in place.
The ideal candidate is not only an exceptional data engineer but also a problem-solver with a keen ability to analyze complex data sets and translate findings into actionable insights. This position requires a strong background in database systems, data modeling, and ETL processes.
Key Responsibilities
- Design, implement, and maintain scalable data architectures and pipelines.
- Develop ETL processes to facilitate smooth data transfer and transformation from various sources.
- Collaborate with data scientists and analysts to fulfill data needs for analytics and reporting.
- Optimize database performance and maintain data integrity across systems.
- Conduct data quality checks and resolve discrepancies.
- Mentor junior data engineers and provide technical guidance.
- Stay current with emerging technologies and best practices in data engineering.
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering or a similar role.
- Proficiency in SQL and experience with relational databases.
- Hands-on experience with data pipeline tools and ETL processes.
- Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
- Experience with cloud-based data solutions is an advantage.
- Remote Model
- Time Flexibility
- Relocation after 6months based on performance
Top Skills
ETL
Hadoop
Spark
SQL
Similar Jobs
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The Senior Data Engineer will manage ETL processes, oversee a team, and guide agile product development while ensuring efficient data integration and governance.
Top Skills:
AgileInformatica B2BInformatica DqInformatica DvoInformatica DxInformatica EdcInformatica IdmcInformatica MftInformatica PmpcInformatica PowercenterInformatica PwxInformatica TdmLinuxPythonWindows
Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
The role involves building ETL processes and data warehousing solutions on Azure, collaborating with project teams, and optimizing data frameworks for analytics.
Top Skills:
AzureAzure Data FactoryAzure DevopsAzure SynapseCosmos DbDatabricksPythonScalaSparkSQL
Cloud • Database
Design and maintain scalable data solutions in Azure, optimize data pipelines and ensure data integrity, while mentoring junior engineers.
Top Skills:
Azure Data FactoryAzure DatabricksEventhubKafkaPysparkPythonSparkSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
