ProArch Logo

ProArch

Senior Data Engineer

Posted 6 Days Ago
Be an Early Applicant
In-Office
Hyderabad, Telangana
Senior level
In-Office
Hyderabad, Telangana
Senior level
The Senior Data Engineer will design scalable data solutions using cloud technologies, mentor junior engineers, and optimize data pipelines for performance and reliability.
The summary above was generated by AI
Description

Founded in 2006, ProArch began as a tight-knit team of business-minded IT professionals passionate about delivering exceptional cloud-based technology solutions. Today, we’ve grown into a global force spread across US, UK and India into multidisciplinary experts spanning cloud, infrastructure, data analytics, cybersecurity, compliance, and software development. Organizations turn to ProArch for forward-thinking guidance, seamless implementation, and dependable ongoing support partnering with us to reach every milestone on the path to their vision.

Our services consist of specific practice areas that are methodically designed to complement and enhance each other's effectiveness. This interconnected approach removes roadblocks and drives rapid growth and financial stability. Many of our clients leverage the full scope of our services, creating a supply chain of value that impacts the entire organization from IT to customer experience.                                                                                                                           

At our core, we believe in the power of technology to transform. We’re passionate about inspiring innovation that shapes our people, our clients, our partners, and the communities we serve.

Job Description:

ProArch is seeking a Senior Data Engineer with 3–5 years of experience to join our Data & Analytics practice. In this role, you will design and deliver scalable data solutions, optimize performance, and enable advanced analytics across cloud platforms. You will work with large-scale datasets, modern cloud-native technologies, and collaborate with business stakeholders to build reliable and secure data ecosystems. This position also involves mentoring junior engineers and driving best practices in DataOps and performance optimization.

Responsibilities

  • Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory.
  • Write efficient Python and SQL code with a focus on scalability, performance, and optimization.
  • Manage Azure Data Lake for structured and unstructured data ingestion at scale (volume, variety, velocity).
  • Implement CI/CD pipelines and follow DataOps practices for automation and reliability.
  • Optimize data partitioning, versioning, and storage/compute costs for large-scale workloads.
  • Ensure high-quality solutions through unit testing frameworks and automated validation.
  • Collaborate with business teams to support analytics, reporting, and data science initiatives.
  • Mentor junior engineers, sharing knowledge and promoting engineering excellence.
Requirements
  • Bachelor’s degree in computer science, IT, Data Engineering, or a related field.
  • 5–8 years of experience in data engineering roles with proven expertise in cloud data platforms.
  • Expert in Python and SQL, with strong performance optimization skills.
  • Proficiency in Azure Synapse Analytics, Spark Pools, and Azure Data Factory (ADF).
  • Hands-on experience with Azure Data Lake and structured ingestion at scale.
  • Experience in CI/CD pipelines and applying DataOps principles.
  • Ability to manage large datasets with diverse structures, velocity, and volume.

Good to Have Skills

  • Experience with Delta Lake, versioned data, and advanced partitioning strategies.
  • Knowledge of data governance and security implementations across platforms.
  • Strong understanding of advanced data modelling (e.g., slowly changing dimensions).
  • Exposure to cost optimization strategies for cloud storage and compute.
  • Experience mentoring or providing technical leadership to junior engineers.

Life @ ProArch

  • At ProArch, we believe our people are the key to our success. That’s why we foster an environment where every employee—known proudly as a ProArchian—can grow, thrive, and make a meaningful impact.
  • We empower employees to develop at their own pace through Career Pathways, a clear and supportive guide to professional progression.
  • Our culture is one of positivity, inclusivity, and respect. Titles don’t define how we treat each other—every ProArchian is valued equally, and collaboration across roles and teams is the norm.
  • We understand that great work starts with balance. That’s why we prioritize work-life harmony, offering flexible work schedules and encouraging time for what matters most.
  • Beyond the workplace, ProArchians actively give back—organizing volunteer efforts and charitable initiatives that empower the communities we call home.
  • And because we know that extraordinary efforts deserve recognition, we celebrate those who go above and beyond with appreciation programs.
  • At ProArch, we’re not just using technology to transform businesses—we’re using it to create a better experience for our people, our clients, and our communities.

Competencies: 

  • Excellent Communication 
  • Analytical Skills 
  • Negotiation Skills
  • Problem Solving Skills 
  • Client Engagement
  • Relationship Building  

Top Skills

Azure Data Factory
Azure Data Lake
Azure Synapse Analytics
Python
Spark Pools
SQL

Similar Jobs

Yesterday
In-Office
Hyderabad, Telangana, IND
Senior level
Senior level
Healthtech
The Senior Data Engineer will design, build, and maintain ETL pipelines and data products, ensuring high-quality and scalable solutions for data needs, while collaborating with various teams and optimizing data infrastructure.
Top Skills: AthenaAWSAws Data Engineering EcosystemAws Data Services (RedshiftAws GlueAzureCloudera Data PlatformGoogle Cloud PlatformLakeformation)MySQLPandasPostgresPrestoPysparkPythonPyTorchRScalaSQLTableau
6 Days Ago
In-Office
Hyderabad, Telangana, IND
Senior level
Senior level
Big Data • Marketing Tech • Analytics
The Senior Data Engineer will collaborate with agile teams to build high-quality solutions, support product lifecycles, and provide technical expertise, emphasizing clean coding practices and AWS technologies.
Top Skills: AWSCi/CdCloudFormationConfluenceGitJIRAKubernetesOpenshiftPythonScalaSonarqubeSparkTerraformVeracode
7 Days Ago
In-Office or Remote
Hyderabad, Telangana, IND
Senior level
Senior level
Cloud • Database
Design and maintain scalable data solutions in Azure, optimize data pipelines and ensure data integrity, while mentoring junior engineers.
Top Skills: Azure Data FactoryAzure DatabricksEventhubKafkaPysparkPythonSparkSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account