As a Lead Software Engineer, you will design, develop, and maintain ETL processes, collaborate with stakeholders, optimize data integration solutions, ensure data quality, and mentor junior engineers while staying updated on industry trends.
Job Description
We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.
As a Lead Software Engineer at JPMorgan Chase within the Securities Services Technology, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. As a core technical contributor, you are responsible for conducting critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.
Job responsibilities
- Design, develop, and maintain ETL processes (using Python, AWS) to support data integration and data warehousing solutions.
- Collaborate with data architects, data analysts, and business stakeholders to understand data requirements and translate them into technical specifications.
- Optimize and tune ETL processes (using Python, AWS) for performance and scalability.
- Ensure data quality and integrity through rigorous testing and validation procedures.
- Monitor and troubleshoot ETL processes to resolve issues and ensure timely data availability.
- Develop and maintain documentation for ETL processes, data flows, and data models.
- Mentor and provide guidance to junior ETL engineers and data team members.
- Stay current with industry trends and best practices in data engineering and ETL technologies.
Required qualifications, capabilities, and skills
- Formal training or certification on software engineering concepts and 5+ years of applied experience
- Hands-on practical experience in ETL development (using Python, AWS) and data engineering
- Preferred experience with Apache Spark
- Strong SQL skills and experience with relational databases (e.g., Oracle, SQL Server, MySQL)
- Good Debugging and Optimization Capabilities
- Understanding of different data formats like CSV, Parquet and ORC and data sources like HDFS, S3, SFTP, Apache Iceberg etc
- Proficient in all aspects of the Software Development Life Cycle
- Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
- Familiarity with other programming languages such as Java or Scala
- Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services
Preferred qualifications, capabilities, and skills
- Experience with big data technologies (e.g., Hadoop).
- Knowledge of data governance and data security best practices.
- Experience with real-time data processing and streaming technologies (e.g., Kafka, Flink).
Top Skills
Java
Python
Scala
SQL
Similar Jobs at JPMorganChase
Financial Services
As a Lead Software Engineer, you'll develop and deliver innovative technology solutions within the AI/ML and Data Platform team. Responsibilities include building secure, high-quality production code, troubleshooting technical issues, automating stability improvements, and leading architectural evaluations with teams and vendors.
Top Skills:
Java
Financial Services
The Software Engineer III will enhance, design, and deliver software components for the Developer Portal team at JPMorgan Chase. Responsibilities include writing secure code, troubleshooting systems, gathering and analyzing data, and collaborating with cross-functional teams, contributing to application stability and security.
Top Skills:
GoJavaPythonReactTypescript
Financial Services
As a Lead Software Engineer, you will develop and deliver market-leading technology solutions, enhance application stability, and troubleshoot technical issues. You will also code securely in Java, support various business functions, and contribute to a diverse team culture.
Top Skills:
Java
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
