Excelencia Consulting Logo

Excelencia Consulting

Sr.Data Engineer

Posted One Month Ago
Be an Early Applicant
In-Office
CORP Colony, Tondiarpet, Chennai, Tamil Nadu, IND
Senior level
In-Office
CORP Colony, Tondiarpet, Chennai, Tamil Nadu, IND
Senior level
Senior Data Engineer responsible for end-to-end design, development, optimization and monitoring of ETL/ELT data pipelines, data warehousing and data lake solutions. Duties include SQL optimization, building scalable big-data architectures (Kafka, Spark, Hadoop), implementing data security, performing root-cause analysis on large/unstructured datasets, and supporting cross-functional teams using cloud data platforms (Snowflake, Databricks, Redshift, BigQuery, Synapse).
The summary above was generated by AI

·       Development, maintenance, and enhancement of Data Pipelines (ETL/ELT) and processes with thorough knowledge of star/snowflake schemas

·       Developing complex SQL queries and SQL optimization

·       Hands on experience in PowerCenter/IDMC/IICS.

·       Development experience must be full Life Cycle experience including business requirements gathering, data sourcing, testing/data reconciliation, and deployment within Business Intelligence/Data Warehousing Architecture.

·       Designing and implementing data security

·       Monitoring and optimizing data storage and data processing

·       Use of Object function/object-oriented scripting languages including Scala, C++, Java and Python

·       Cloud data warehouse and data lake platforms (e.g., Snowflake, Databricks, Redshift, BigQuery, MS Synapse, MS ADLS, Apache Haddop, etc.)

 

·       Developing data services that are fit for purpose, resilient, scalable, and future proof, to meet user needs

·       Advanced SQL knowledge and experience working with relational databases and working familiarity with various databases.

·       Demonstrated understanding and experience using software and tools including ETL, relational SQL and NoSQL databases, big data tools like Kafka, Spark, and Hadoop

·       Experience building and optimizing ‘big data’ data pipelines, architecture, and data sets.

·       Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

·       Strong analytic skills related to working with unstructured datasets.

·       Experience and knowledge of project management best practices and agile software development methodologies

·       A successful history of manipulating, processing, and extracting value from large, disconnected datasets.

·       Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

·       Strong project management and organizational skills.

·       Experience supporting and working with cross-functional teams in a dynamic environment.

·       Understanding of data science concepts

·       Familiarity with AI/ML frameworks and libraries



Requirements
  • Procurement / Supplier data
  • Inventory and warehouse management data
  • Demand planning and forecasting
  • Production orders, BOMs, routings
  • Shop floor / MES data
  • Quality systems (defects, CAPA, nonconformance)


Similar Jobs

8 Days Ago
In-Office
Chennai, Tamil Nadu, IND
Senior level
Senior level
Artificial Intelligence • Big Data • Cloud • Consulting
Designs, develops, and optimizes scalable data pipelines, ETL/ELT processes, integrations, and cloud data platforms. Ensures data quality, governance, reliability, monitoring, and operational efficiency across batch and real-time workflows. Supports Meridian platform implementation, troubleshooting, and deployment while collaborating with architects, analysts, product owners, and stakeholders. Provides technical guidance, participates in architecture and code reviews, mentors engineers, and promotes automation, documentation, and engineering best practices.
Top Skills: Apache AirflowAutomated TestingAWSAzureAzure Data FactoryAzure SynapseCi/CdData LakesData WarehousingDatabricksDevOpsEtl/EltEvent HubsGCPInfrastructure As CodeJavaKafkaMeridianMicrosoft FabricPythonScalaSnowflakeSpark StreamingSQL
4 Hours Ago
Hybrid
Chennai, Tamil Nadu, IND
Senior level
Senior level
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Lead independent manual and automated quality assurance testing for software projects. Develop and contribute to Java-based automation frameworks using BDD, Cucumber, Selenium, and related tools. Execute diverse tests, analyze failures, identify root causes, manage defects through closure, and ensure accurate test documentation. Collaborate with developers on feature-branch certification, apply AI tools, and support agile delivery while maintaining quality, timelines, and customer-focused technology solutions.
Top Skills: Ai ToolsAmazon EksBddCucumberDevOpsDockerGoogle Cloud Platform (Gcp)JavaJmeterKubernetesSeleniumTest Management Systems
5 Hours Ago
In-Office
Chennai, Tamil Nadu, IND
Expert/Leader
Expert/Leader
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Leads delivery of enterprise conversational AI platforms, including chatbots and voice bots. Oversees Agile execution, technical architecture, cloud-native engineering, CI/CD, Terraform, Responsible AI, and AI adoption. Partners with product, security, architecture, and business teams while managing risks and executive communication. Mentors engineers and technical leads, supports hiring and performance management, and ensures scalable, secure, compliant, and operationally excellent solutions.
Top Skills: Agentic AiAmazon ConnectAmazon LexAWSAzureCcaasCi/CdConversational AiDevOpsDevsecopsFive9Generative AiGenesysGoogle AdkGCPGoogle DialogflowLlmsNiceNode.jsPythonRagShift-Left EngineeringTerraformTypescript

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account