DATAMAXIS, Inc Logo

DATAMAXIS, Inc

Lead Data Engineer – PySpark & Cloud Integration

Reposted 3 Days Ago
Be an Early Applicant
India
Senior level
India
Senior level
Looking for a Lead Data Engineer with PySpark and cloud integration experience to design solutions, mentor junior engineers, and troubleshoot performance issues.
The summary above was generated by AI

OFFSHORE only

Job Summary:
Looking for a developer who has hands-on experience with Databricks/Pyspark , Java, Webservices.  Position is long-term and will likely be renewed annually. 

Minimum Qualifications and Job Requirements:

* Must be a team player.
 * Must have at least 5 years of IT development experience.
 * Must have strong analytical and problem-solving skills.
 * Must have experience in designing solutions, performing code reviews, and mentoring junior engineers.
 * Must have strong SQL and backend experience and be working on data-driven projects.
 * Must have the following experience:
Python/PySpark
SQL/ PL/SQL
Databricks
 * Java/C#
 * Preferred to have the following experience:
Azure
Kafka
Node JS
Azure Data Factory 

Essential Job Functions:

- Understands the full picture and helps operations with monitoring, dashboards, etc.
- Work with the architect on the design
- Constantly keeps an eye on the cost and performance of the system
- Work with BA on the integration requirements
- Ability to troubleshoot performance issues and other functional issues
- Attention to detail and documents the key decisions made
- Able to mentor or guide junior developers and do code reviews
- Ability to handle fast-paced projects and willing to look into production issues

Other Responsibilities: 

* Document and maintain project artifacts.
* Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
* Safeguard the company’s assets.
* Adhere to the company’s compliance program.
* Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
* Maintain focus on customer service, efficiency, quality, and growth.
* Collaborating with additional team members
* Other duties as assigned. 

Top Skills

Azure
Azure Data Factory
Databricks
Java
Kafka
Node Js
Pl/Sql
Pyspark
SQL
Webservices

Similar Jobs

14 Minutes Ago
Hybrid
Hyderabad, Telangana, IND
Junior
Junior
Fintech • Financial Services
The Technology Business Systems Consultant analyzes business problems, evaluates solutions, manages customer onboarding, and interfaces with technology teams, ensuring effective communication and training.
Top Skills: Active DirectoryApigeeAPIsCrm ToolsMicrosoft Dynamic 365SalesforceZoho Crm
16 Minutes Ago
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
Senior level
Senior level
Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
This role manages project delivery, team leadership, and functional system administration/data integration within automotive technology, focusing on quality service and collaboration.
Top Skills: AbapB2BLesMesMicrosoft AnalyticsSap BasisSap Erp
16 Minutes Ago
Hybrid
Bangalore, Bengaluru Urban, Karnataka, IND
Mid level
Mid level
Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
The position involves providing SAP support, analyzing user requirements, troubleshooting issues, and implementing SAP solutions in a global environment. Candidates should have analytical skills and experience in the automotive industry.
Top Skills: AbapS/4HanaSap Erp Ecc 6.0

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account