Endava Logo

Endava

Senior Data Engineer with Python and Databricks

Posted 15 Days Ago
Be an Early Applicant
Iași
Senior level
Iași
Senior level
The Senior Data Engineer role involves collaborating with data scientists and analysts to build effective data pipelines and solutions. Responsibilities include designing and maintaining data ingestion and processing pipelines using Azure services, performing data validation and cleansing, and ensuring the reliability of data. Monitoring and enhancing the efficiency of data pipelines are also key aspects of this role.
The summary above was generated by AI

Company Description

Technology is our how. And people are our why. For over two decades, we have been harnessing technology to drive meaningful change.
By combining world-class engineering, industry expertise and a people-centric mindset, we consult and partner with leading brands from various industries to create dynamic platforms and intelligent digital experiences that drive innovation and transform businesses.
From prototype to real-world impact - be part of a global shift by doing work that matters.

Job Description

  • Work together with data scientists and analysts to understand the needs for data and create effective data pipelines
  • Solution design, implement, and maintain data pipelines for data ingestion, processing, and transformation using could services and other technologies
  • Create and maintain data solutions IN Azure, using any of the following: Data Factory, Synapse, Databricks/Spark, Polars/Pandas, Fabric 
  • Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.
  • Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
  • Monitoring and resolving data pipeline problems, ensuring consistency and availability of the data.


Qualifications

  • Proficient in Python and SQL
  • Knowledge of good data design principles (concepts such as Kimball and Star Schema), data warehousing concepts and data modelling.
  • Strong experience with Relational and ideally NoSQL databases.
  • Strong understanding of ETL/ELT processes.
  • Exposure to data monitoring and observability tools.
  • Relevant experience with Event-Driven Architecture
  • Good understanding of Agile ways of working

Additional Information

Discover some of the global benefits that empower our people to become the best version of themselves:

  • Finance: Competitive salary package, share plan, company performance bonuses, value-based recognition awards, referral bonus;
  • Career Development: Career coaching, global career opportunities, non-linear career paths, internal development programmes for management and technical leadership;
  • Learning Opportunities: Complex projects, rotations, internal tech communities, training, certifications, coaching, online learning platforms subscriptions, pass-it-on sessions, workshops, conferences;
  • Work-Life Balance: Hybrid work and flexible working hours, employee assistance programme;
  • Health: Global internal wellbeing programme, access to wellbeing apps;
  • Community: Global internal tech communities, hobby clubs and interest groups, inclusion and diversity programmes, events and celebrations.

Our diversity makes us stronger - it drives meaningful change and enables us to build innovative technology solutions. We are committed to creating an inclusive community where all of us, regardless of background, identity, or personal characteristics, feels valued, respected, and free from discrimination. As an equal opportunity employer, we welcome applications from all individuals and base hiring decisions on merit, skills, qualifications, and potential.

Top Skills

Python
SQL

Similar Jobs

3 Days Ago
Iași, ROU
Senior level
Senior level
Software
Senior data engineers at Thoughtworks build and maintain data architecture and infrastructure for applications, develop data processing pipelines, collaborate with data scientists, and ensure data governance and quality.
Top Skills: PythonSQL
2 Days Ago
Iași, ROU
Senior level
Senior level
Software • Consulting
The Senior Data Science/AI Specialist will collaborate with clients to identify their needs, design and implement data science and AI projects. Responsibilities include data analysis, modeling with advanced statistical methods, cloud hosting management, data integration, and visualization, while effectively communicating insights to stakeholders and contributing to business development efforts.
Top Skills: PythonSQL
2 Days Ago
Iași, ROU
Senior level
Senior level
Software
Lead the execution of data science projects, managing cross-functional collaborations, developing machine learning models, and ensuring data quality. Communicate insights to stakeholders effectively and promote a culture of data literacy within the organization.
Top Skills: PythonR

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account