As an AWS PySpark Developer, you'll design and produce software solutions, optimize engineering capabilities, and collaborate within a team across the software life cycle, focusing on high-quality outcomes.
Join us as an AWS Pyspark Developer
- This is an opportunity for a driven Software Engineer to take on an exciting new career challenge
- Day-to-day, you'll be engineering and maintaining innovative, customer centric, high performance, secure and robust solutions
- It’s a chance to hone your existing technical skills and advance your career while building a wide network of stakeholders
- We're offering this role at associate level
In your new role, you’ll be working within a feature team to engineer software, scripts and tools, as well as liaising with other engineers, architects and business analysts across the platform.
You’ll also be:
- Producing complex and critical software rapidly and of high quality which adds value to the business
- Working in permanent teams who are responsible for the full life cycle, from initial development, through enhancement and maintenance to replacement or decommissioning
- Collaborating to optimise our software engineering capability
- Designing, producing, testing and implementing our working software solutions
- Working across the life cycle, from requirements analysis and design, through coding to testing, deployment and operations
To take on this role, you’ll need a background in software engineering, software design, and architecture, and an understanding of how your area of expertise supports our customers. You'll need at least six years of experience working with PySpark, AWS Data Engineering eco Systems like Athena, Glue Catalog, S3, EMR Serverless and Airflow.
You’ll also need:
- Experience of working with development and testing tools, bug tracking tools and wikis
- Experience in multiple programming languages or low code toolsets
- Experience of DevOps and Agile methodology and associated toolsets
- A background in solving highly complex, analytical and numerical problems
- Experience of implementing programming best practice, especially around scalability, automation, virtualisation, optimisation, availability and performance
Hours
45Job Posting Closing Date:
27/05/2026NatWest Group Chennai, Tamil Nadu, IND Office
Kosmo One, Plot No 14 3rd Main Road, Ambattur Industrial Estate, Chennai, Tamil Nadu, India, 600 058
Similar Jobs
Fintech • Payments • Financial Services
The role involves engineering software and tools, collaborating within teams, and managing software throughout its lifecycle, requiring extensive experience in PySpark and AWS tools.
Top Skills:
AirflowAthenaAWSEmr ServerlessGluePysparkS3
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
The Sr. Manager, Cloud & AI Engineer oversees cloud infrastructure, backend services, and AI/ML operations, driving innovations and ensuring scalable production-grade environments.
Top Skills:
AnsibleAWSAws Secrets ManagerAzureBashBedrockDockerElkGithub ActionsGrafanaHelmJenkinsKubernetesLangchainLangfuseMlflowOpentelemetryPrometheusPythonSagemakerTerraformVault
Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
The Sr. Manager, AI Engineer is responsible for developing AI-powered features, integrating ML models, and ensuring quality in product delivery while collaborating with cross-functional teams at Pfizer.
Top Skills:
DashPower BIPythonReactSQLStreamlitTableauVue
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
