Design, build, and maintain scalable data pipelines and infrastructure (SQL warehouses, data lakes) using Azure and Databricks. Write production-grade PySpark/Python and SQL, consolidate and clean data, implement ETL/ELT, data modeling, orchestration/monitoring, and produce Power BI dashboards. Collaborate with stakeholders on data lineage and document processes for reproducibility.
Location:
Chennai, Tamil Nadu, IndiaJob ID:
R0124753Date Posted:
2026-07-01Company Name:
HITACHI ENERGY TECHNOLOGY SERVICES PRIVATE LIMITEDProfession (Job Category):
Engineering & ScienceJob Schedule:
Full timeRemote:
NoJob Description:
Your Responsibilities:
- Display technical expertise in data analytics focusing on a team of diversified technical competencies.
- Build and maintain accurate and scalable data pipeline and infrastructure such as SQL Warehouse, Data Lakes, etc. using Cloud platforms (e.g.: MS Azure, Databricks).
- Proactively work with business stakeholders to understand data lineage, definitions, and methods of data extraction.
- Write production-grade SQL and PySpark code to create data architecture.
- Consolidate SQL databases from multiple sources, data cleaning, and manipulation in preparation for analytics and machine learning.
- Use data visualization tools such as Power BI to create professional quality dashboards and reports.
- Write good quality documentation for data processing for different projects to ensure reproducibility.
- Living Hitachi Energy’s core values safety and integrity, which means taking responsibility for your own actions while caring for your colleagues and the business.
Your Background:
- BE / B.Tech in Computer Science, Data Science, or related discipline and at least 5 years of related working experience.
- 5 years of data engineering experience, with understanding lake house architecture, data integration framework, ETL/ELT pipeline, orchestration/monitoring, star schema data modeling.
- 5 years of experience with Python/PySpark and SQL(Proficient in PySpark, Python, and Spark SQL)
- 2-3 years of hands-on data engineering experience using Databricks as the main tool (meaning >60% of their time is using Databricks instead of just occasionally).
- 2-3 years of hands-on experience with different Databricks components (DLT, workflow, Unity catalog, SQL warehouse, CI/CD) in addition to using notebooks.
- Experience in Microsoft Power BI.
Additional Insights:
- Basic understanding of Machine Learning algorithms.
- Enhanced Data Processing: AI/ML can automate and improve data processing tasks, making them more efficient and accurate.
- Predictive Analytics: Integrating AI/ML can help in building predictive models that can forecast trends and outcomes, providing valuable insights for decision-making.
- Personalization: AI/ML can be used to create personalized experiences for users by analyzing their behavior and preferences.
- Automation: AI/ML can automate repetitive tasks, freeing up time for more complex and creative work.
- Ability to quickly grasp concepts from a field that is not one's core competency; A fast learning generalist capable of solving problems independently and resourceful in a matrixed corporate environment.
- Proficiency in both spoken & written English language is required.
Hitachi Chennai, Tamil Nadu, IND Office
Chennai, India
Similar Jobs
Digital Media • Information Technology • News + Entertainment
Design, build, and optimize scalable data pipelines and structures for analytics and downstream applications. Implement SQL-based transformations, ingestion frameworks, and validation checks across cloud platforms (Snowflake, Databricks). Ensure data quality, lineage, governance, and operational reliability. Collaborate with stakeholders, mentor junior engineers, and improve internal data engineering tools, automation, and CI/CD processes.
Top Skills:
AirflowApache IcebergSparkAWSAws S3AzureCi/CdDatabricksDbtGCPPythonSnowflakeSQL
Digital Media • Information Technology • News + Entertainment
Design, build, and optimize scalable data pipelines and platforms (Snowflake, Databricks, Spark). Ensure data quality, lineage, and observability. Mentor junior engineers, lead cross-team initiatives, implement CI/CD, and improve internal data engineering tools and architectures.
Top Skills:
AirflowSparkAWSAws S3AzureCi/CdDatabricksDbtGCPIcebergPythonSnowflakeSQL
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and maintain cloud-native data pipelines and ETL/ELT workflows for high-volume trade lifecycle data. Integrate DTCC sources (RTTM, Settlement Web) into a Unified Trade Record, process ISO 15022 messages, manage trade exception databases, optimize SQL Server performance, and ensure data quality, lineage, governance, and observability while collaborating with business stakeholders.
Top Skills:
AWSDockerDtcc RttmDtcc Settlement WebEksEltETLFixFxmlIbm MqIndexingIso 15022KafkaKubernetesRdsRest ApiS3SQLSQL ServerStored ProceduresUnified Trade Record (Utr)
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
