Presidio Logo

Presidio

Lead Engineer - Data

Posted 16 Days Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Lead Azure Data Engineer to design, build, and operate petabyte-scale data systems on Azure. Lead a data engineering team to develop ETL pipelines (ADF, Synapse, Databricks), perform data modelling, migrations, monitoring, security, and collaborate with BI/ML/Product teams while mentoring junior engineers and improving analytics and dashboarding.
The summary above was generated by AI

SEIZE THE OPPORTUNITY TO BE A PART OF SOMETHING GREAT!

Presidio is on the leading edge of a technology-driven movement to transform the way business is done, for our customers and our customers' customers. Joining Presidio means immersing yourself in a culture of self-starters, collaborators and innovators who make real, lasting change in the marketplace via cutting-edge technology and business solutions. At Presidio, we know that it’s our people that make the connections happen.

WHY YOU SHOULD JOIN US? You will set your career on track for outstanding achievement with a company that knows no limits. Presidio is a leading a global digital services and solutions provider focused on Digital Infrastructure, Business Analytics, Cloud, Security & Emerging solutions.

THE ROLE: Lead Engineer - Data 

Years of Experience – 7 years and above

Location – Chennai, Coimbatore, Bangalore & Hyderabad

Description
As an Azure Lead Data Engineer, your main responsibility is to design, develop, and oversee data systems on the Microsoft Azure cloud platform. You will lead a team of data engineers and collaborate with other teams to ensure the reliability and scalability of our data systems.

If you thrive on the challenges posed by big data, then this role is perfect for you. We are seeking Data Engineers who can handle a high volume of events daily, manage petabyte-scale data on Azure SQL, Azure Synapse Analytics and Azure Data Lake, and create data pipelines using technologies such as ADF, Synapse Pipeline, Synapse notebook (PySpark/SparkSQL) and SQL

We are looking for talented, enthusiastic, and detail-oriented individuals with a background in Data Engineering, Data Science, Business Intelligence, or Software Development. You should be adept at tackling big data challenges in an agile manner. Your responsibilities will include designing and analysing big data, data modelling, and developing, deploying, and managing big data pipelines. Additionally, you will assist in recruiting, mentoring, and developing colleagues in the Data Analytics team, including Data Scientists, Data Engineers, and Software Engineers. Your role will involve collaborating with Coda to construct data pipelines and datasets, as well as expanding self-service data knowledge.

This position requires you to operate at the intersection of data and engineering. You should have a deep understanding of data, analytical techniques, and how to apply insights to drive business outcomes. Practical experience in maintaining the highest operational standards for ETL and big data pipelines is essential.

We primarily work with Azure technologies such as Azure SQL, Azure Data Factory, Azure Synapse, Azure Dedicated SQL Pool, Azure Data Lake, Azure Databricks, PySpark, SparkSQL, Azure Analysis Services, SSIS, PowerBI, and Data Modelling. In this role, you will build our data portfolio and collaborate with Product, Marketing, BI, and ML teams to create new behavioural events, pipelines, datasets, models, and reports to support their initiatives. You will also enhance our offline analytics capabilities in Tableau and expand our real-time dashboarding capabilities

Basic Qualifications

  • Designing and implementing large-scale data processing systems on Azure, including data ingestion, storage, processing, and visualization.
  • Developing data integration and migration strategies to move data from legacy systems to Azure.
  • Building data pipelines and ETL workflows using Azure Data Factory, Azure Databricks, or other relevant tools.
  • Designing and implementing data models, data warehouses, and data lakes using Azure Synapse Analytics, Azure SQL Data Warehouse, or other relevant tools.
  • Working with data scientists and analysts to understand their data requirements and ensure that the data infrastructure supports their needs.
  • Monitoring and troubleshooting the performance and availability of the data systems and implementing strategies to improve their reliability and scalability. 
  • Managing security and access controls for the data systems, including managing roles and permissions, implementing encryption, and complying with regulatory requirements.
  • Mentoring and guiding junior data engineers and providing technical leadership to the team. 

*****

ABOUT PRESIDIO

Presidio is committed to Diversity, Equity, and Inclusion at the highest levels and has strengthened its drive to build and drive systemic DEI change process across all levels of the organization. Cultivating a culture of inclusion where the expression of all our differences are valued, celebrated, and add to our collective achievements.

Presidio is a global digital services and solutions provider accelerating business transformation through secured technology modernization. Highly skilled teams of engineers and solutions architects with deep expertise across cloud, security, networking and modern data center infrastructure help customers acquire, deploy and operate technology that delivers impactful business outcomes. Presidio is a trusted strategic advisor with a flexible full life cycle model of professional, managed, and support and staffing services to help execute, secure, operationalize and maintain technology solutions. We serve as an extension of our clients' IT teams, providing deep expertise and letting them focus on their core business. Presidio operates in 40+ US offices and offices in Ireland, London, Singapore, and India.

For more information visit: http://presidio.com

Similar Jobs

5 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Fintech • Financial Services
Lead and architect scalable cloud-based data platforms, build data ingestion/transformation code, mentor engineers, define best practices (CI/CD, testing, observability), drive data strategy, evaluate new tools, and enforce governance, security, and privacy.
Top Skills: AirflowSparkBigQueryCassandraClaude CodeDagsterData LakesData WarehousesDataflowDataprocDevinEmrEvent-Driven SystemsFlinkGcsGithub ActionsGitlab CiHadoopHiveImpalaJenkinsKafkaKinesisMicroservicesMicrosoft CopilotMongoDBOraclePostgresPrefectPythonRedshiftRestful ApisS3ScalaSQL
20 Days Ago
In-Office or Remote
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Generative AI
Lead design and delivery of AWS Data Lakehouse solutions using Medallion architecture. Architect and automate cloud infrastructure, optimize Redshift/Glue performance and costs, enforce data governance and quality, implement CDC/ETL pipelines, and liaise with Data Science/BI and business stakeholders. Mentor engineers and drive technical roadmap and migrations.
Top Skills: Amazon AthenaAmazon RedshiftAmazon S3Apache AirflowAws DmsAws GlueAws Glue Data QualityAws Glue DatabrewAws Lake FormationAws Step FunctionsDbtDockerGithub ActionsIamMicrosoft FabricOpenlineageParquetPower BIPower Bi EmbeddedPysparkPythonRedshift ServerlessSnowflakeSQLTerraform
22 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Mid level
Mid level
Artificial Intelligence • HR Tech • Professional Services • Software
Design, build, and optimize large-scale cloud data platforms and ETL/ELT pipelines on Azure. Implement data lakes, Delta Lake, Synapse, and Databricks solutions for batch and real-time processing, ensure data quality/governance, optimize SQL and analytics workloads, support CI/CD and deployments, and collaborate with stakeholders to deliver scalable data architectures and reporting.
Top Skills: Azure Data FactoryAzure Synapse AnalyticsCi/CdData LakeDatabricksDelta LakeDevOpsEtl/EltPysparkRbacSparkSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account