The Senior Data Engineer will design and optimize data infrastructures and pipelines to support analytics, ensuring data integrity and quality.
BlackStone eIT is on the lookout for a Senior Data Engineer to join our innovative team. In this role, you will be responsible for the design, development, and optimization of our data infrastructure. You'll play a crucial part in supporting data analytics initiatives across the organization by ensuring we have robust and scalable data pipelines in place.
The ideal candidate is not only an exceptional data engineer but also a problem-solver with a keen ability to analyze complex data sets and translate findings into actionable insights. This position requires a strong background in database systems, data modeling, and ETL processes.
Key Responsibilities
- Design, implement, and maintain scalable data architectures and pipelines.
- Develop ETL processes to facilitate smooth data transfer and transformation from various sources.
- Collaborate with data scientists and analysts to fulfill data needs for analytics and reporting.
- Optimize database performance and maintain data integrity across systems.
- Conduct data quality checks and resolve discrepancies.
- Mentor junior data engineers and provide technical guidance.
- Stay current with emerging technologies and best practices in data engineering.
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering or a similar role.
- Proficiency in SQL and experience with relational databases.
- Hands-on experience with data pipeline tools and ETL processes.
- Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
- Experience with cloud-based data solutions is an advantage.
- Remote Model
- Time Flexibility
- Relocation after 6months based on performance
Top Skills
ETL
Hadoop
Spark
SQL
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer, you'll build and maintain data pipelines, work on data lakes, and enhance self-service capabilities while transforming vague requirements into actionable solutions.
Top Skills:
AirflowAWSEmrHiveJavaKinesisPythonRdsS3ScalaSparkSQLSqs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer at Atlassian, you'll build and optimize data pipelines and micro-services, working with AWS-based data lakes and enhancing data accessibility for stakeholders while ensuring data quality.
Top Skills:
AirflowAWSDatabricksEmrHiveJavaKinesisPythonRdsS3ScalaSparkSQLSqs
Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
As a Senior Data Engineer at Takeda, you will design and implement complex data structures and pipelines, lead the ingestion of structured and unstructured data, develop data quality methodologies, and influence analytics to derive actionable insights from large data sets, while collaborating closely with architects and product owners.
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.