InOrg Global Logo

InOrg Global

Data Engineer

Reposted 17 Days Ago
Remote
Hiring Remotely in India
Mid level
Remote
Hiring Remotely in India
Mid level
The Data Engineer will design, build, and maintain scalable data pipelines using Databricks, integrating data into systems and ensuring data quality and performance while collaborating with stakeholders.
The summary above was generated by AI

Job Summary:

We're seeking an experienced Data Engineer/ Sr Data Engineer / Lead Data Engineer

With expertise in data engineering across major data platforms. The ideal candidate will have a

strong background in Python, SQL, ETL, and data modeling, with experience in tools like

Teradata, Informatica, Hadoop, Spark, PySpark, ADF, Snowflake, and Big Data. Cloud

knowledge (AWS, Azure, or GCP) is a plus. The role requires a willingness to transition and

upskill into Databricks & AI/ML projects.

Key Responsibilities:

● Design, develop, and maintain large-scale data systems

● Develop and implement ETL processes using various tools and technologies

● Collaborate with cross-functional teams to design and implement data models

● Work with big data tools like Hadoop, Spark, PySpark, and Kafka

● Develop scalable and efficient data pipelines

● Troubleshoot data-related issues and optimize data systems

● Transition and upskill into Databricks & AI/ML projects

Requirements:

● Relevant  years of experience in data engineering

● Strong proficiency in Python, SQL, ETL, and data modeling

● Experience with one or more of the following:

○ Teradata

○ Informatica

○ Hadoop

○ Spark

○ PySpark

○ ADF

○ Snowflake

○ Big Data

○ Scala

○ Kafka

● Cloud knowledge (AWS, Azure, or GCP) is a plus

● Willingness to learn and adapt to new technologies, specifically Databricks & AI/ML

Nice to Have:

● Experience with Databricks

● Knowledge of AI/ML concepts and tools

● Certification in relevant technologies

What We Offer:

● Competitive salary and benefits

● Opportunity to work on cutting-edge projects

● Collaborative and dynamic work environment

● Professional growth and development opportunities

● Remote work opportunities & flexible hours

Top Skills

Airflow
Spark
AWS
Azure
Databricks
Databricks Rest Api
Databricks Sql
Datadogs
Delta Lake
GCP
Git
Mlflow
Prometheus
Python
Rest Apis
Scala

Similar Jobs

7 Days Ago
Remote or Hybrid
India
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Data Engineer will work on GCP services and handle big data through ETL processes, employing strong problem-solving skills and analytical abilities.
Top Skills: BigtableCloud FunctionsCloud RunDatastoreGCPJavaPysparkPythonSpannerSQL
14 Days Ago
Remote or Hybrid
Bengaluru, Bengaluru Urban, Karnataka, IND
Expert/Leader
Expert/Leader
Cloud • Fintech • Information Technology • Machine Learning • Software • App development • Generative AI
Lead architecture, design, development, and delivery of enterprise data platform components. Build and optimize ETL/ELT pipelines, data models, and warehouses (Snowflake). Mentor engineers, drive data governance, ensure performance, security, and scalability, and collaborate cross-functionally to adopt best practices and new tools.
Top Skills: Sql,Snowflake,Python,Java,Rdbms,Nosql,Elt/Etl Tools,Stored Procedures,Ctes,Udfs,Cloud-Native (Google Cloud Preferred),Data Warehouse
15 Days Ago
Remote or Hybrid
India
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Design, build, and operate scalable ETL/ELT pipelines using PySpark and AWS data services. Orchestrate workflows with Apache Airflow, implement AWS Glue jobs and Data Catalog, manage Lake Formation permissions, publish datasets for BI, and deliver QuickSight visualizations while ensuring data quality and performance.
Top Skills: Pyspark,Apache Airflow,Aws Glue,Aws Lake Formation,Aws Glue Data Catalog,Amazon Quicksight

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account