The Data Engineer III at PDI Technologies will develop and manage cloud-based data pipelines, ensure system performance, and collaborate with teams for data management.
At PDI Technologies, we empower some of the world's leading convenience retail and petroleum brands with cutting-edge technology solutions that drive growth and operational efficiency.
By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make more informed decisions, and engage faster with customers through loyalty programs, shopper insights, and unmatched real-time market intelligence via mobile applications, such as GasBuddy. We’re a global team committed to excellence, collaboration, and driving real impact. Explore our opportunities and become part of a company that values diversity, integrity, and growth.
Role Overview:
PDI is seeking a talented and motivated Full Time Data Engineer III to join our elite agile data services team responsible for developing and maintaining our industry-leading cloud-based big data and data analytics infrastructure serving major global fortune 500 companies.
The ideal candidate will have hands-on experience in coding data pipelines, administering databases, and working with business users to understand and meet their data requirements. This role involves maintaining high performance and security of our data systems, performing quality assurance, and supporting the company’s data infrastructure, primarily using AWS, Snowflake and DBT.
Key Responsibilities:
- Design and manage complex data architectures.
- Lead the development and optimization of data pipelines and ETL processes.
- Mentor junior engineers and provide technical guidance.
- Collaborate with cross-functional teams to understand and meet data requirements.
- Ensure the reliability and performance of data systems.
- Conduct data validation and quality assurance.
- Document data workflows and technical specifications.
- Participate in agile development processes.
- Implement industry standards and best practices.
- Maintain data security and compliance.
- Provide on-call support as required.
- Estimate and plan data engineering projects.
- Develop strategies for data storage, processing, and archiving.
- Troubleshoot and resolve complex data issues.
Qualifications:
- Advanced SQL skills and proficiency in multiple programming languages.
- Extensive experience with data warehousing, specifically Snowflake.
- Proficiency in DBT (Data Build Tool).
- Extensive experience in Cloud, such as AWS, GCP or Azure
- Strong problem-solving and project management skills.
- Excellent communication and leadership abilities.
- Bachelor’s or master’s degree in computer science, Information Technology, or a related field.
Preferred Qualifications:
- Certifications such as Snowflake SnowPro Core Certification, dbt Certification, AWS Certified Data Analytics are a plus.
Behavioral Competencies:
- Cultivates Innovation
- Decision Quality
- Manages Complexity
- Drives Results
- Business Insight
PDI is committed to offering a well-rounded benefits program, designed to support and care for you, and your family throughout your life and career. This includes a competitive salary, market-competitive benefits, and a quarterly perks program. We encourage a good work-life balance with ample time off [time away] and, where appropriate, hybrid working arrangements. Employees have access to continuous learning, professional certifications, and leadership development opportunities. Our global culture fosters diversity, inclusion, and values authenticity, trust, curiosity, and diversity of thought, ensuring a supportive environment for all.
Top Skills
AWS
Dbt
Snowflake
SQL
Similar Jobs
Digital Media • Gaming • Internet of Things • News + Entertainment • Retail • Business Intelligence • Cybersecurity
The Engineer 4 is responsible for planning, designing, and developing software and web applications, overseeing documentation and performance metrics, and training junior staff.
Top Skills:
Quality AssuranceSoftware DevelopmentWeb Applications
Digital Media • Gaming • Internet of Things • News + Entertainment • Retail • Business Intelligence • Cybersecurity
This role requires designing and developing software and web applications, collaborating with stakeholders, and providing technical leadership to junior engineers.
Top Skills:
Quality AssuranceSoftware DevelopmentWeb Applications
Digital Media • Gaming • Internet of Things • News + Entertainment • Retail • Business Intelligence • Cybersecurity
The role involves planning, designing, and implementing software and web applications, with responsibilities including testing, debugging, and documentation.
Top Skills:
Engineering MethodologiesProject ManagementQuality AssuranceSoftware DevelopmentWeb Applications
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
