Crayon Data Logo

Crayon Data

Data Engineer

Posted 4 Days Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Mid level
In-Office
Chennai, Tamil Nadu, IND
Mid level
Design, build, and maintain scalable ETL/ELT data pipelines and integrations from multiple sources. Optimize performance and reliability, implement cloud-based data architectures (AWS/Azure/GCP), collaborate with data scientists and product teams, and enforce best practices for testing, automation, security, and documentation.
The summary above was generated by AI
Data Engineer – Chennai
Build the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.
Location: Chennai, India
Experience: 3–5 years in data engineering or data-driven product development
Role Overview

As a Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that enable AI and analytics solutions. You’ll work closely with data scientists, software engineers, and product teams to ensure data is clean, reliable, and ready for advanced modeling and insights.


What You’ll Do
  • Data Pipeline Development – Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data.

  • Data Integration – Ingest data from various sources (APIs, databases, cloud storage) into centralized data platforms.

  • Performance Optimization – Enhance data processing speed, reliability, and scalability.

  • Cloud Data Engineering – Work with cloud platforms (AWS, Azure, or GCP) for data storage, processing, and orchestration.

  • Collaboration – Partner with data scientists and analysts to ensure data availability and quality for downstream use cases.

  • Best Practices – Ensure code quality, data security, and maintainability through testing, automation, and documentation.


What Makes You Right for This Role
  • 2–3 years of experience in data engineering, data warehousing, or big data environments.

  • Strong programming skills in Python or Java (experience with PySpark or Scala is a plus).

  • Hands-on experience with ETL tools and data pipeline frameworks (e.g., Airflow, Spark, Kafka).

  • Proficiency in working with SQL and relational databases (PostgreSQL, MySQL, etc.).

  • Familiarity with cloud platforms such as AWS (Glue, S3, Redshift), Azure (Data Factory, Synapse), or GCP (BigQuery, Dataflow).

  • Exposure to containerization (Docker, Kubernetes) and CI/CD workflows is a plus.

  • Passionate about data, automation, and building systems that drive intelligent decision-making.

  • Based in Chennai, with flexibility to collaborate with global teams.


Crayon Data Tech Stack

Java | Python | Spark | Kafka | Airflow |



Crayon Data Chennai, Tamil Nadu, IND Office

5th Floor, # 33-B, Software Block, ELNET SOFTWARE CITY, Old Mahabalipuram Road, Taramani, Chennai, Tamil Nadu, India, 600 113

Similar Jobs

2 Days Ago
Hybrid
Chennai, Tamil Nadu, IND
Senior level
Senior level
Digital Media • Information Technology • News + Entertainment
Design, build, and maintain advanced data structures and pipelines for SAP HANA SPM. Implement inbound/outbound integrations with CRM/ERP and data warehouses, ensure data quality, reconciliation, governance, and auditability. Troubleshoot production issues, support UAT and post-deployment validation, document business rules and flows, and provide technical leadership and mentoring.
Top Skills: CRMData WarehousesErpSalesforceSap Hana SpmSnowflakeTeradata
5 Days Ago
Hybrid
Senior level
Senior level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Design and implement scalable data engineering solutions and EDW data models. Build ETL/ELT pipelines (IICS) into Snowflake, optimize performance, enforce governance, support production deployments, conduct code reviews, troubleshoot issues, and collaborate with cross-functional teams to deliver robust, maintainable data platforms.
Top Skills: AWSAzureEtl/EltInformatica Intelligent Cloud Service (Iics)JavaPythonSnowflakeSQL
5 Days Ago
Hybrid
Senior level
Senior level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Design, build, and maintain scalable EDW data pipelines and models using Snowflake and IICS. Collaborate with cross-functional teams, enforce governance and standards, conduct code reviews, troubleshoot production issues, and drive continuous improvement of data engineering practices.
Top Skills: AWSAzureEdwEltETLInformatica Intelligent Cloud Service (Iics)JavaPythonSnowflakeSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account