Citi Logo

Citi

Python and Apache Spark Big Data Engineer - Assistant Vice President

Posted 6 Days Ago
Be an Early Applicant
In-Office
Pune, Mahārāshtra
Expert/Leader
In-Office
Pune, Mahārāshtra
Expert/Leader
Develop and maintain scalable Python and Scala applications for big data platforms. Design high-performance Spark components, process large datasets using Hive, Impala, and HBase, tune application performance, troubleshoot issues, and implement testing and SDLC practices. Translate requirements into technical solutions, identify bottlenecks, establish development standards, collaborate with global teams, and transfer tested prototypes to operations.
The summary above was generated by AI

Experience Range - 8 to 12 years

Strong experience with one or more programming languages (Python/Spark).
•  Demonstrated analytical and problem-solving skills. Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain. 
•  Comfortable working with large data volumes and be able to demonstrate a firm understanding of logical data structures and analysis techniques. 
•  Experience in Big data technologies like HDFS, Map Reduce, YARN, Apache Spark, Hive. 
•  Familiarity with data formats like Avro, Parquet, CSV, JSON. 
•  Strong systems analysis, design and architecture fundamentals, Unit Testing and other SDLC activities. 
•  Understanding fundamental design principles behind a scalable application. 
•  Experience in working with UNIX/LINUX and shell scripting. 
•  Good knowledge of database principles, practices with SQL. 
•  Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain. Good to Have: 
•  Agile/Scrum methodology experience is required. 
•  Experience in SCMs like GIT and tools like JIRA. 
•  Experience in No SQL databases. 
•  Familiarity with build tools such as Maven and continuous integration like Jenkins/Team City. 
•  Familiarity with cloud and container technologies. 
•  Experience real time data processing - Kafka. 
Responsibilities: 
•  Translate application storyboards and use cases into functional applications. 
•  Design, build, and maintain efficient, reusable, and reliable Python/Scala code. 
•  Ensure the best possible performance, quality, and responsiveness of the applications. 
•  Identify bottlenecks and bugs, and devise solutions to these problems. 
•  Develop high performance & low latency components to run Spark clusters. 
•  Interpreting functional requirements into design approaches those can be served through Big Data platform. 
•  Collaborate and partner with Global Teams based across different locations. 
•  Be able to propose best practices and standards. 
•  Perform the testing of software prototypes and transfer to the operational team. 
•  Processing of data using Hive, Impala & HBASE. 
•  Performing analysis of large data sets and derive insights.

------------------------------------------------------

Job Family Group: Technology

------------------------------------------------------

Job Family:Applications Development

------------------------------------------------------

Time Type:Full time

------------------------------------------------------

Most Relevant Skills Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.

Citi Chennai, Tamil Nadu, IND Office

C P Ramaswamy Road, Chennai, Tamil Nadu, India, 600018

Similar Jobs

16 Minutes Ago
Hybrid
Senior level
Senior level
Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
Senior quality engineering role within Magna’s automotive mechatronics and mirrors division. The provided description contains no specific day-to-day responsibilities or qualification requirements beyond supporting automotive technology development in a global manufacturing environment.
3 Hours Ago
Remote or Hybrid
India
Mid level
Mid level
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Provides systems safety engineering for aircraft turbine engines and auxiliary power systems. Conducts hazard and safety analyses, develops safety requirements and documentation, supports FAA and EASA compliance, performs reliability analysis, and reviews designs. Collaborates across engineering teams on risk mitigation, corrective actions, and aftermarket safety metrics. The role also supports process standardization, automation, AI application, technical coaching, innovation, and strategies to reduce certification cycle time and cost.
Top Skills: Artificial IntelligenceDoorsDoors NgModel-Based Systems Engineering
3 Hours Ago
Remote or Hybrid
India
Expert/Leader
Expert/Leader
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Leads embedded software and firmware development for processor simulators and emulators, including requirements, architecture, design, coding, qualification, and technical support. Develops QEMU and KVM-based tools, ports Linux or RTOS to SoCs, and works with ARM architectures and low-level hardware interfaces. Owns simulator strategy, roadmaps, issue resolution, design decisions, stakeholder collaboration, process improvement, and team mentoring while driving innovation and competitive product development.
Top Skills: ArmAssemblyBitbucketCC++Do-178B/CDo-330DoorsEclipseEthernetGdbGpioKvmLauterbachLinuxMpsocPciQemuRtosSocSvnTrace32Visual Studio

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account