Citi Logo

Citi

Applications Development Sr Programmer Analyst - Data Engineer (Pyspark/Snowflake/ AWS)- C12 - PUNE

Job Posted 13 Days Ago Posted 13 Days Ago
Be an Early Applicant
In-Office
Pune, Mahārāshtra
Senior level
In-Office
Pune, Mahārāshtra
Senior level
The Data Engineer will design, develop, and optimize ETL pipelines using PySpark and AWS for data processing, collaborate with teams, and ensure data compliance.
The summary above was generated by AI

Role Overview:

We are seeking an experienced Data Engineer with expertise in PySpark, Snowflake and AWS  to join our team. The ideal candidate will design, develop, and optimize data pipelines and workflows in a cloud-based environment, leveraging AWS services, PySpark, and Snowflake for data processing and analytics.

Key Responsibilities:

Design and implement scalable ETL pipelines using PySpark on AWS.
Develop and optimize data workflows for Snowflake integration.
Manage and configure AWS services such as S3, Lambda, Glue, EMR, and Redshift.
Collaborate with data analysts and business teams to understand requirements and deliver solutions.
Ensure data security and compliance with best practices in AWS and Snowflake environments.
Monitor and troubleshoot data pipelines and workflows for performance and reliability.
Write efficient, reusable, and maintainable code for data processing and transformation.

Required Skills:
Strong experience with AWS services (S3, Lambda, Glue, MSK, etc.).
Proficiency in PySpark for large-scale data processing.
Hands-on experience with Snowflake for data warehousing and analytics.
Solid understanding of SQL and database optimization techniques.
Knowledge of data lake and data warehouse architectures.
Familiarity with CI/CD pipelines and version control systems (e.g., Git).
Strong problem-solving and debugging skills.

Experience with Terraform or CloudFormation for infrastructure as code.
Knowledge of Python for scripting and automation.
Familiarity with Apache Airflow for workflow orchestration.
Understanding of data governance and security best practices.
Certification in AWS or Snowflake is a plus.

Education and Experience:

Bachelor’s degree in Computer Science, Engineering, or related field with 6 to 10 years of experience.
5+ years of experience in AWS cloud engineering.
2+ years of experience with PySpark and Snowflake.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Digital Software Engineering

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Top Skills

Pyspark,Snowflake,Aws,S3,Lambda,Glue,Emr,Redshift,Sql,Git,Terraform,Cloudformation,Python,Apache Airflow

Citi Chennai, Tamil Nadu, IND Office

C P Ramaswamy Road, Chennai, Tamil Nadu, India, 600018

Similar Jobs

11 Hours Ago
Hybrid
2 Locations
Senior level
Senior level
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
The role involves developing AbInitio solutions, guiding junior developers, ensuring code quality, and collaborating with technical teams while enhancing applications.
Top Skills: AbinitioCi/CdCloudHadoopJenkinsLinux
2 Days Ago
Hybrid
Pune, Mahārāshtra, IND
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The SME - Sales Commission will manage compensation projects, ensure accurate commission payments, support sales teams, and perform general accounting tasks in a fast-paced environment.
Top Skills: SalesforceXactly
2 Days Ago
Hybrid
Pune, Mahārāshtra, IND
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
The role involves managing AMER payroll, reconciling payroll data, supporting payroll projects, and ensuring timely processing across multiple jurisdictions including the US, Canada, Mexico, and Brazil. It requires strong analytical skills and collaboration with various teams.
Top Skills: Adp CeridianAdp Global ViewAdp Workforce NowNetSuiteSAPWorkday

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account