PDI Technologies Logo

PDI Technologies

Data Engineer III

Sorry, this job was removed at 09:40 a.m. (IST) on Friday, Jan 17, 2025
Be an Early Applicant
Hybrid
Chennai, Tamil Nadu
Hybrid
Chennai, Tamil Nadu

At PDI Technologies, we empower some of the world's leading convenience retail and petroleum brands with cutting-edge technology solutions that drive growth and operational efficiency.

 

By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make more informed decisions, and engage faster with customers through loyalty programs, shopper insights, and unmatched real-time market intelligence via mobile applications, such as GasBuddy. We’re a global team committed to excellence, collaboration, and driving real impact. Explore our opportunities and become part of a company that values diversity, integrity, and growth.


Role Overview:


PDI is seeking a talented and motivated Full Time Data Engineer III to join our elite agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies.


The ideal candidate will have hands-on experience in coding data pipelines, administering databases, and working with business users to understand and meet their data requirements. This role involves maintaining high performance and security of our data systems, performing quality assurance, and supporting the company’s data infrastructure, primarily using AWS, Snowflake and DBT.

Key Responsibilities:

  • Design and manage complex data architectures.
  • Lead the development and optimization of data pipelines and ETL processes.
  • Mentor junior engineers and provide technical guidance.
  • Collaborate with cross-functional teams to understand and meet data requirements.
  • Ensure the reliability and performance of data systems.
  • Conduct data validation and quality assurance.
  • Document data workflows and technical specifications.
  • Participate in agile development processes.
  • Implement industry standards and best practices.
  • Maintain data security and compliance.
  • Provide on-call support as required.
  • Estimate and plan data engineering projects.
  • Develop strategies for data storage, processing, and archiving.
  • Troubleshoot and resolve complex data issues.

Qualifications:

  • Advanced SQL skills and proficiency in multiple programming languages.
  • Extensive experience with data warehousing, specifically Snowflake.
  • Proficiency in DBT (Data Build Tool).
  • Extensive experience in Cloud, such as AWS, GCP or Azure
  • Strong problem-solving and project management skills.
  • Excellent communication and leadership abilities.
  • Bachelor’s or master’s degree in computer science, Information Technology, or a related field.

Preferred Qualifications:

  • Certifications such as Snowflake SnowPro Core Certification, dbt Certification, AWS Certified Data Analytics are a plus.

Behavioral Competencies:

  • Ensures Accountability
  • Manages Complexity
  • Communicates Effectively
  • Balances Stakeholders
  • Collaborates Effectively

PDI is committed to offering a well-rounded benefits program, designed to support and care for you, and your family throughout your life and career. This includes a competitive salary, market-competitive benefits, and a quarterly perks program. We encourage a good work-life balance with ample time off [time away] and, where appropriate, hybrid working arrangements. Employees have access to continuous learning, professional certifications, and leadership development opportunities. Our global culture fosters diversity, inclusion, and values authenticity, trust, curiosity, and diversity of thought, ensuring a supportive environment for all.

Similar Jobs

2 Days Ago
Easy Apply
Chennai, Tamil Nadu, IND
Easy Apply
Mid level
Mid level
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
As a Data Platform Engineer, you will design and build a self-service data infrastructure for Udemy's data mesh. You'll create scalable data pipelines using AWS services and tools like Airflow and Kafka, and contribute to data quality and privacy initiatives. You will work collaboratively in a dynamic environment focused on innovation.
Top Skills: JavaPythonScala
18 Days Ago
Chennai, Tamil Nadu, IND
Senior level
Senior level
Software
The Data Engineer III at PDI Technologies develops and maintains cloud-based data analytics infrastructure, designing data architecture, optimizing data pipelines, and ensuring data system reliability. They lead projects, mentor junior engineers, and collaborate with teams to meet data needs, while maintaining data security and compliance.
Top Skills: SQL
59 Minutes Ago
Chennai, Tamil Nadu, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Machine Learning • Software
As a Staff Data Engineer at Genesys, you will design and maintain data pipelines, work with cross-functional teams, ensure data quality, and serve as a technical leader, guiding junior staff and influencing best practices.
Top Skills: JavaPythonRSparkSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account