Responsible for designing, developing, and optimizing data infrastructure and pipelines to support analytics initiatives, ensuring data quality and performance.
BlackStone eIT is on the lookout for a Senior Data Engineer to join our innovative team. In this role, you will be responsible for the design, development, and optimization of our data infrastructure. You'll play a crucial part in supporting data analytics initiatives across the organization by ensuring we have robust and scalable data pipelines in place.
The ideal candidate is not only an exceptional data engineer but also a problem-solver with a keen ability to analyze complex data sets and translate findings into actionable insights. This position requires a strong background in database systems, data modeling, and ETL processes.
Key Responsibilities
- Design, implement, and maintain scalable data architectures and pipelines.
- Develop ETL processes to facilitate smooth data transfer and transformation from various sources.
- Collaborate with data scientists and analysts to fulfill data needs for analytics and reporting.
- Optimize database performance and maintain data integrity across systems.
- Conduct data quality checks and resolve discrepancies.
- Mentor junior data engineers and provide technical guidance.
- Stay current with emerging technologies and best practices in data engineering.
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering or a similar role.
- Proficiency in SQL and experience with relational databases.
- Hands-on experience with data pipeline tools and ETL processes.
- Familiarity with big data technologies (e.g., Hadoop, Spark) is a plus.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
- Experience with cloud-based data solutions is an advantage.
Benefits
- Remote Model
- Time Flexibility
- Relocation after 6months based on performance
Top Skills
Hadoop
Spark
SQL
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
This role involves designing, building, and scaling a Data+ML platform, collaborating on machine learning pipelines, and incorporating cloud services for deployment and execution.
Top Skills:
AirflowSparkFlinkFluxcdJavaJupyter NotebooksKubernetesMlflowPythonRayTerraformVertex Ai
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Sr. Engineer on the Data + ML Platform team, you will design and build scalable ML pipelines and ensure best practices in development and deployment, shaping critical business decisions in modern cybersecurity.
Top Skills:
AirflowSparkCi/Cd FrameworksFlinkFluxcdGithub ActionsJavaJupyter NotebooksKubernetesMlflowNvidia WorkbenchPythonRayScalaTerraformVertex Ai
Pharmaceutical
The Senior Data Engineer at Parexel will analyze data, design databases, develop ETL solutions, mentor staff, and ensure software quality within the pharmaceutical industry.
Top Skills:
ArchimateAzure Analysis ServicesAzure SqlBpmnDatabricksInformaticaInformatica Data QualityQlikSparx EaSQLSynapseTogafUml
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
