.png)
.png){kind=logo}
The Associate Data Engineer assists in designing, building, and maintaining data systems for analytics and reporting, focusing on data pipelines, infrastructure, and collaboration with stakeholders.
Job Purpose and Impact
The Associate Data Engineer job assists with the design, building and maintenance of routine data systems that enable data analysis and reporting. Under close supervision, this job provides collaboration to support that large sets of data are efficiently processed and made accessible for decision making.
Key Accountabilities
Qualifications
The Associate Data Engineer job assists with the design, building and maintenance of routine data systems that enable data analysis and reporting. Under close supervision, this job provides collaboration to support that large sets of data are efficiently processed and made accessible for decision making.
Key Accountabilities
- DATA & ANALYTICAL SOLUTIONS: Assists with the development of basic data products and solutions using big data and cloud-based technologies, supporting scalable, sustainable and robust designs.
- DATA PIPELINES: Collaborates with the development of basic streaming and batch data pipelines that facilitate the seamless ingestion of data from various data sources, transform the data into information and move to data stores like data lake, data warehouse and others.
- DATA SYSTEMS: Assists with the implementation of existing data systems and architectures in support of improvement and optimization activities.
- DATA INFRASTRUCTURE: Supports the preparation of data infrastructure aligned with the efficient storage and retrieval of data.
- DATA FORMATS: Helps implement appropriate data formats to improve data usability and accessibility across the organization.
- STAKEHOLDER MANAGEMENT: Assembles requirements from multi-functional partners assisting the team to ensure that data solutions meet the functional and non-functional needs of various partners.
- DATA FRAMEWORKS: Conducts basic testing of new concepts and assists with the implementation of data engineering frameworks and architectures to support the improvement of data processing capabilities and analytics initiatives.
- AUTOMATED DEPLOYMENT PIPELINES: Collaborates with the implementation of automated deployment pipelines to support improving efficiency of code deployments with fit for purpose governance.
- DATA MODELING: Performs basic data modeling aligned with the datastore technology to ensure sustainable performance and accessibility.
Qualifications
- Have a Bachelor's degree with 2 years or more of relevant experience.
- CLOUD ENVIRONMENTS: Basic familiarity with major cloud platforms (AWS, GCP, Azure) and interest in learning how cloud services support data pipelines and storage.
- DATA ARCHITECTURE: Introductory understanding of modern data architectures such as data lakes and lakehouses, with exposure to concepts like ingestion, governance, and basic data modeling.
- DATA INGESTION: Hands-on experience or coursework using data ingestion tools (e.g., Kafka, AWS Glue) and awareness of common data storage formats like Parquet or Iceberg.
- DATA STREAMING: Foundational understanding of streaming concepts and exposure to tools such as Kafka or Flink.
- DATA MODELING: Experience writing SQL and supporting data transformation tasks. Familiarity with modeling concepts (e.g., SCDs, schema evolution) and introductory experience with tools like dbt, Airflow, or AWS Glue.
- DATA TRANSFORMATION: Basic experience using Spark or similar frameworks for data processing, with a willingness to learn more advanced topics like performance tuning and debugging.
- PROGRAMMING: Proficiency in at least one programming language (typically Python) and ability to write clean, reusable code. Comfortable with SQL basics and working toward stronger query optimization skills.
- DEVOPS: General awareness of DevOps practices such as version control (Git) and basic CI/CD concepts. Interest in learning deployment and automation workflows.
- DATA GOVERNANCE: Foundational understanding of data quality, security, and privacy principles. Awareness of best practices for handling data responsibly.
Top Skills
Airflow
AWS
Aws Glue
Azure
Dbt
Flink
GCP
Git
Iceberg
Kafka
Parquet
Python
Spark
SQL
Similar Jobs at Cargill
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Design, build, test, deploy, and support integrations between SuccessFactors Employee Central and enterprise systems using SAP CPI. Collaborate with HR, IT, and stakeholders to gather requirements, troubleshoot issues, and ensure compliance, security, and performance.
Top Skills:
Sap Cloud Platform Integration (Cpi)SuccessfactorsSuccessfactors Employee Central
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Design, develop, test, and maintain front-end software features; automate deployments; collaborate with product, design, and engineering teams to gather requirements; write unit and integration tests; debug and provide technical support; produce and maintain documentation; suggest and implement process improvements to increase reliability and efficiency.
Food • Greentech • Logistics • Sharing Economy • Transportation • Agriculture • Industrial
Designs and implements security controls for applications, data, and multi-cloud environments; oversees data protection and lineage; conducts security delivery for ERP, performance monitoring, QA testing, and supports data privacy during incidents.
Top Skills:
Application SecurityCloudData LineageData PrivacyData ProtectionErpMulti-CloudPaasSaaSSast
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
