NatWest Group Logo

NatWest Group

Senior Data Engineer, Director

Posted 10 Days Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Design, build, and maintain scalable data pipelines, ETL processes, and data architectures (lakes, warehouses). Develop real-time streaming apps (Spark Streaming, Flink), optimize Spark performance, ensure data quality, governance, and security, integrate AI/ML pipelines, evaluate new data technologies, troubleshoot pipeline performance, and mentor junior engineers.
The summary above was generated by AI

Join us as a Senior Data Engineer

  • We’ll look to you to drive the build of effortless, digital-first customer experiences as you simplify our bank while keeping our data safe and secure
  • Day-to-day, you’ll develop innovative, data-driven solutions through data pipeline modelling and ETL design, inspiring to be commercially successful through insights
  • This is your opportunity to explore your leadership potential while bringing a competitive edge to your career profile by solving problems and creating smarter solutions
  • We're offering this role at director level
What you’ll do

In this role, you’ll design, build and maintaining scalable data pipelines and architectures. The ideal candidate will have strong expertise in handling large data sets, optimising data flows, and collaborating closely with data scientists, analysts, and other engineering teams to enable data-driven decision-making.

We’ll look to you to design, develop, and maintain scalable data pipelines and ETL processes to support analytics and reporting requirements, while building and optimizing data architectures including data lakes, data warehouses, and databases. You'll develop and support real-time data streaming applications using Apache Spark Streaming and Apache Flink, perform Spark performance tuning for large-scale data processing, and collaborate closely with data scientists and analysts to deliver clean, reliable, and high-quality datasets.

You’ll also be responsible for:

  • Driving customer value by understanding complex business problems and requirements to correctly apply the most appropriate and reusable tools to gather and build data solutions
  • Ensureing data quality, integrity, and security across all data platforms.
  • Implementing best practices for data governance and compliance.
  • Monitoring and troubleshooting data pipeline performance and resolve data-related issues proactively.
  • Evaluating and integrating new data technologies and tools to enhance data processing capabilities, with a focus on AI tools and concepts.
  • Collaborating with cross-functional teams to support data-driven initiatives.
  • Mentoring and guiding junior data engineers and team members.
The skills you’ll need

We’re looking for someone with strong communication skills and the ability to proactively engage and manage a wide range of stakeholders. You'll need at least twelve years of professional experience as a Data Engineer or in a similar role, with strong expertise in Apache Spark including Spark Streaming and performance optimization, Scala, Python, and Apache Flink for real-time data processing. You'need expertise in AI concepts and tools within data engineering workflows, build high-performance data APIs using FastAPI, and working extensively with AWS services such as EMR, Kinesis, DynamoDB, Athena, and QuickSight.

You'll need hands-on experience with data lake technologies and formats including Parquet and Apache Iceberg, containerization platforms such as Docker and Podman, and relational databases including PostgreSQL and Hive, supported by strong SQL skills. You'll also contribute to machine learning pipeline integration, ensure compliance with GDPR and other data privacy regulations, and hold a Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field.

You’ll also need:

  • Expertise in ETL tools and frameworks and data pipeline orchestration.
  • Strong understanding of cloud data platforms and services.
  • Knowledge of data modelling, schema design, and data architecture principles.
  • Familiarity with data security standards and compliance requirements.
  • Experience with DevOps, CI/CD pipelines, and container orchestration like Kubernetes
  • An understanding of modern code development practices

Hours

45

Job Posting Closing Date:

24/08/2026

NatWest Group Chennai, Tamil Nadu, IND Office

Kosmo One, Plot No 14 3rd Main Road, Ambattur Industrial Estate, Chennai, Tamil Nadu, India, 600 058

Similar Jobs

An Hour Ago
Hybrid
Chennai, Tamil Nadu, IND
Junior
Junior
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Processes and fulfills transactional, batch, and self-service data requests within service-level agreements. Validates inputs, system setups, data extraction, cleansing, outputs, and reports using Ab Initio on UNIX. Coordinates with customer engagement and sales teams, resolves data concerns and complaints, ensures quality and turnaround targets, follows documented procedures, and identifies process improvements. The role requires SQL and Python expertise, attention to detail, problem-solving ability, and willingness to work US shifts.
Top Skills: Ab InitioAutosysMS OfficePythonSQLUnix
An Hour Ago
Hybrid
Chennai, Tamil Nadu, IND
Junior
Junior
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Processes and fulfills transactional, batch, and self-service customer requests within service-level agreements. Validates system setups, input data, data extraction, cleansing, and outputs to ensure accurate, timely delivery. Collaborates with customer engagement and Sales teams, resolves data concerns and complaints, maintains documentation, monitors KPIs, and identifies process improvements. Supports migration initiatives using SQL and Python.
Top Skills: AutosysETLMS OfficePythonSQLUnix
Entry level
Big Data • Food • Hardware • Machine Learning • Retail • Automation • Manufacturing
Manage cocoa nursery operations, agronomy, farmer training, crop development, procurement, bean quality, and dispatch. Support Cocoa Life sustainability programs, research collaborations, government liaison, digital farmer onboarding, farm mapping, and data collection. The role involves managing nursery and collection staff, coordinating third-party buying partners, extensive farm visits, and implementing safety, compliance, and sustainability initiatives.
Top Skills: AIExcelMicrosoft PowerpointMicrosoft WordPolygon MappingSAPTally

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account