Excelencia Consulting Logo

Excelencia Consulting

Sr.Data Engineer

Posted 29 Days Ago
Be an Early Applicant
In-Office
CORP Colony, Tondiarpet, Chennai, Tamil Nadu, IND
Senior level
In-Office
CORP Colony, Tondiarpet, Chennai, Tamil Nadu, IND
Senior level
Senior Data Engineer responsible for end-to-end design, development, optimization and monitoring of ETL/ELT data pipelines, data warehousing and data lake solutions. Duties include SQL optimization, building scalable big-data architectures (Kafka, Spark, Hadoop), implementing data security, performing root-cause analysis on large/unstructured datasets, and supporting cross-functional teams using cloud data platforms (Snowflake, Databricks, Redshift, BigQuery, Synapse).
The summary above was generated by AI

·       Development, maintenance, and enhancement of Data Pipelines (ETL/ELT) and processes with thorough knowledge of star/snowflake schemas

·       Developing complex SQL queries and SQL optimization

·       Hands on experience in PowerCenter/IDMC/IICS.

·       Development experience must be full Life Cycle experience including business requirements gathering, data sourcing, testing/data reconciliation, and deployment within Business Intelligence/Data Warehousing Architecture.

·       Designing and implementing data security

·       Monitoring and optimizing data storage and data processing

·       Use of Object function/object-oriented scripting languages including Scala, C++, Java and Python

·       Cloud data warehouse and data lake platforms (e.g., Snowflake, Databricks, Redshift, BigQuery, MS Synapse, MS ADLS, Apache Haddop, etc.)

 

·       Developing data services that are fit for purpose, resilient, scalable, and future proof, to meet user needs

·       Advanced SQL knowledge and experience working with relational databases and working familiarity with various databases.

·       Demonstrated understanding and experience using software and tools including ETL, relational SQL and NoSQL databases, big data tools like Kafka, Spark, and Hadoop

·       Experience building and optimizing ‘big data’ data pipelines, architecture, and data sets.

·       Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

·       Strong analytic skills related to working with unstructured datasets.

·       Experience and knowledge of project management best practices and agile software development methodologies

·       A successful history of manipulating, processing, and extracting value from large, disconnected datasets.

·       Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.

·       Strong project management and organizational skills.

·       Experience supporting and working with cross-functional teams in a dynamic environment.

·       Understanding of data science concepts

·       Familiarity with AI/ML frameworks and libraries



Requirements
  • Procurement / Supplier data
  • Inventory and warehouse management data
  • Demand planning and forecasting
  • Production orders, BOMs, routings
  • Shop floor / MES data
  • Quality systems (defects, CAPA, nonconformance)


Similar Jobs

31 Minutes Ago
Remote or Hybrid
India
Entry level
Entry level
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Processes client orders and legal documents, responds to internal and external inquiries, updates customer records, manages portfolios, fulfills orders across jurisdictions, coordinates project progress, navigates multiple databases, and resolves documentation issues while maintaining accuracy and strong customer service.
Top Skills: MS OfficeSalesforce
2 Hours Ago
Remote or Hybrid
India
Entry level
Entry level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Document and implement new CRD6 regulatory reporting processes, including Third Country Branch, HU, and Ultimate HU workflows. Coordinate with finance teams and multiple stakeholders to define and agree processes, document Target Operating Models, and track project progress, risks, and issues.
3 Hours Ago
Easy Apply
Remote or Hybrid
India
Easy Apply
Senior level
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Monitor security alerts, detect and analyze threats, respond to security incidents, assess their scope and impact, and investigate phishing incidents. The role requires experience with SOC operations, SIEM, EDR, IDS/IPS, firewalls, antivirus tools, networks, operating systems, and endpoint fundamentals. Preferred qualifications include AI-assisted threat detection, security scripting, and certifications such as Security+, CISSP, or CISM.
Top Skills: Ai/MlAntivirusCC#ChronicleComputer NetworksCrowdstrike FalconEdrEndpoint SecurityFirewallsIds/IpsOperating SystemsPowershellPythonSIEM

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account