Yadimen Consulting Limited Jobs

Data Engineer — PySpark + AWS Glue

Yadimen Consulting Limited

Data Engineer — PySpark + AWS Glue

Posted 22 Days Ago

Be an Early Applicant

In-Office

Chennai, Tamil Nadu, IND

Senior level

In-Office

Chennai, Tamil Nadu, IND

Senior level

Design, develop, optimize, and maintain scalable ETL pipelines using PySpark and AWS Glue. Build data ingestion and transformation workflows, orchestrate processes with AWS Step Functions, and develop Python-based AWS Lambda functions. Support AWS data lake architectures, analytical use cases, monitoring, reliability, and performance optimization. The role also involves SQL and may include Java microservices, REST APIs, and backend integrations.

The summary above was generated by AI

Data Engineer — PySpark + AWS Glue

ETL & Data Pipelines | 2 Openings

Location: Remote (UK)

Employment Type: Contract / Permanent

Experience Level: 4–8 Years

Openings: 2

About the Role

We are looking for a skilled Data Engineer with solid hands-on experience in PySpark, AWS Glue, and ETL development to build and maintain scalable, production-grade data pipelines on AWS. You will be part of a delivery-focused team working on complex data engineering challenges, contributing to data lake architecture and end-to-end pipeline development.

Requirements

Key Responsibilities

• Design, develop, and maintain scalable ETL pipelines using PySpark and AWS Glue

• Build and optimise data ingestion, transformation, and loading workflows

• Orchestrate data workflows using AWS Step Functions

• Develop serverless functions using AWS Lambda (Python)

• Work with data lake architectures on AWS to support analytical use cases

• Ensure pipeline reliability, monitoring, and performance optimisation

Required Skills & Experience

• Strong hands-on experience with PySpark and AWS Glue

• Proven track record in ETL pipeline development and optimisation

• Experience orchestrating workflows with AWS Step Functions

• Proficiency in serverless development using AWS Lambda (Python)

• Good SQL skills and a solid understanding of data processing principles

Nice to Have

• Exposure to Java-based microservices

• Understanding of REST APIs and backend service integrations

• Experience working with AWS-based data lakes

Similar Jobs

Coursera + Udemy

Content Marketing Manager

8 Hours Ago

Remote or Hybrid

India

Senior level

Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI

Lead enterprise content marketing initiatives across industries and buyer personas. Develop and manage data reports, e-books, videos, articles, webinars, and webpages; create briefs, messaging, and outlines; write and edit content; ensure brand consistency; and coordinate with product, regional, demand generation, customer marketing, sales, and creative teams. Use audience insights, SEO, AI-powered tools, and performance metrics to support full-funnel campaigns and editorial planning.

Top Skills: Ai-Powered Content ToolsAioGeoSeo

Zocdoc

Sales Development Representative

2 Days Ago

Easy Apply

Hybrid

Easy Apply

Entry level

Healthtech • Information Technology • Software • Telehealth

The Sales Development Representative generates outbound leads through cold calling, email, and account research; qualifies prospects; schedules meetings for Sales Executives; handles objections; tracks meeting outcomes; and collaborates with global sales teams. The role includes intensive training, coaching, feedback, remote work, and an overnight shift from approximately 7:30 p.m. to 4:30 a.m.

Top Skills: High-Speed Internet

CSC

Associate Client Order Coordinator

2 Days Ago

Remote or Hybrid

India

Entry level

Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy

Coordinates client orders and processes legal and corporate documents across multiple jurisdictions. Responsibilities include responding to client inquiries, maintaining customer records, managing portfolios, navigating databases, fulfilling orders, reviewing filings, communicating project progress, and resolving documentation issues. The role requires strong customer service, attention to detail, organization, problem-solving, communication, and the ability to work accurately in a fast-paced, high-volume environment.

Top Skills: MS OfficeSalesforce

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.