IBS Software Logo

IBS Software

Data Engineer

Posted 7 Days Ago
In-Office or Remote
Hiring Remotely in India
Mid level
In-Office or Remote
Hiring Remotely in India
Mid level
Design, build, and optimize ETL pipelines and data warehouses using SQL, AWS Glue, and S3. Investigate and resolve data issues, develop Python-based solutions and small web apps, and own requirements, design, and end-to-end delivery for change requests.
The summary above was generated by AI

Proficient in writing and optimizing SQL queries. Excellent working knowledge with SQL-based databases (Redshift, PostgreSQL, MySQL) and data warehousing platforms. Hands-on experience with ETL (Extract, Transform, Load) processes. Expertise in AWS services, including AWS Glue and S3, for data processing and storage. Conduct data investigations to resolve technical, procedural, and operational issues. Solve complex business problems using disciplined development methodologies to produce scalable, flexible, efficient, and supportable solutions. Excellent programming skills in Python, with the capability to develop small to medium web applications. Should take full ownership of the change request, including requirement analysis, design, and end-to-end delivery, ensuring successful implementation with complete accountability.

IBS Software Chennai, Tamil Nadu, IND Office

RMZ Millenia Business Park II, Campus – 5, 9th Floor, No.143, Dr. M.G.R. Road, , , Chennai, Tamil Nadu, India, 600096

Similar Jobs

4 Days Ago
In-Office or Remote
Expert/Leader
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead data engineering architecture and execution for large-scale, low-latency analytics. Own technical direction, ensure operational data quality, design streaming and batch pipelines, mentor engineers, coordinate cross-functional teams, and deliver scalable solutions using Spark, Airflow, and AWS or equivalent data platforms.
Top Skills: AirflowAthenaColumn StoresDatabricksDatabricks ApisEmrFlinkHiveKafkaKappa ArchitectureLambda ArchitectureMaster Data Management (Mdm)Microservices ArchitectureRedshiftSparkSQLStreaming Pipelines
Yesterday
Remote or Hybrid
India
Mid level
Mid level
Big Data • Cloud • Logistics • Machine Learning • Retail
Leads architecture and development of large-scale batch and real-time data platforms and pipelines. Ensures data quality, governance, reliability, observability, scalability, and cost efficiency while building self-service capabilities. Supports analytics, machine learning, and generative AI teams with trusted data infrastructure. Establishes engineering standards, mentors engineers, and drives platform health across multiple teams. The role requires expertise in data integration, distributed processing, data modeling, cloud platforms, CI/CD, and infrastructure automation.
Top Skills: Apache AirflowApache BeamApache FlinkApache HiveSparkBigQueryCi/CdETLGoogle Cloud PlatformInfrastructure AutomationJavaPrestoPythonScalaWcag 2.2 Aa
2 Days Ago
Remote
India
Entry level
Entry level
Agency • Information Technology
Develop and maintain reliable data pipelines, ELT processes, workflow orchestration, custom data connectors, and CI/CD pipelines using Airflow, Python, PySpark, Hive/Trino, SQL, and Snowflake. Collaborate with cross-functional teams, monitor and troubleshoot data workflows, validate and test data, document technical processes, and support data governance.
Top Skills: Apache AirflowCi/CdHivePysparkPythonSnowflakeSQLTrino

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account