OneMagnify Logo

OneMagnify

Senior Data Engineer-Chennai

Posted 4 Days Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Lead design and delivery of scalable data platforms and production-grade pipelines using Databricks and cloud providers. Build batch and real-time ETL, implement data models for analytics, ensure data quality and governance, integrate AI/GenAI capabilities, mentor junior engineers, and drive client-facing technical discussions and architecture reviews.
The summary above was generated by AI
As a Senior Data Engineer at OneMagnify, you will be at the forefront of our Data & Analytics practice. You will lead the development and delivery of scalable data platforms and AI-powered solutions, translating business requirements into production-grade data pipelines. Your role will be essential in enabling advanced analytics and integrating AI/GenAI capabilities into enterprise data ecosystems, ensuring flawless execution and delivery.
The OneMagnify team is looking for a Senior Data Engineer who will help to develop, enhance, and improve scalable data pipelines by using Databricks and cloud platforms.

OneMagnify is an AI native, platform-enabled B2B digital agency operating at the intersection of data, technology, and creativity. We help complex organizations drive measurable business outcomes by building smarter customer experiences and delivering highly integrated solutions across digital, media, and technology. By combining deep industry expertise with advanced analytics and artificial intelligence, we enable our clients to make better decisions, move faster, and compete more effectively in dynamic markets.  

Role Summary 

As a Senior Data Engineer at OneMagnify, you will be at the forefront of our Data & Analytics practice. You will lead the development and delivery of scalable data platforms and AI-powered solutions, translating business requirements into production-grade data pipelines. Your role will be essential in enabling advanced analytics and integrating AI/GenAI capabilities into enterprise data ecosystems, ensuring flawless execution and delivery. 

The OneMagnify team is looking for a Senior Data Engineer who will help to develop, enhance, and improve scalable data pipelines by using Databricks and cloud platforms.  

The Impact You’ll Have: 

  • Motivated to advance innovation and excellence in data engineering. 

  • Exceptional attention and diligence for data quality, governance, and reliability. 

  • A deep understanding of modern data architecture patterns, ensuring alignment to standard methodologies. 

  • Ability to develop and implement high-quality data solutions using advanced technologies. 

What you’ll do: 

  • Build, develop, and optimize high-capacity data workflows using Databricks (Delta Lake, Spark).  

  • Build and maintain batch and real-time processing pipelines on cloud platforms. 

  • Implement data models, transformations, and performance optimizations for large-scale datasets. 

  • Ensure data accuracy, management, and dependability in production systems. 

  • Act as a technical lead for small to mid-sized teams, driving build discussions, code reviews, and engineering guidelines. 

  • Own end-to-end delivery of data solutions from ingestion to transformation and BI/visualization (Power BI/Tableau). 

  • Be responsible for the design and implementation of data models optimized for analytics and reporting (star/snowflake schemas).  

  • Mentor junior engineers and BI developers, ensuring high-quality, scalable, and user-friendly work. 

  • Work directly with clients to understand requirements and translate them into solutions. 

  • Lead technical discussions, solution walkthroughs, and architecture reviews. 

What you’ll need: 

  • 6–9 years of practical experience in data engineering or analytics roles. 

  • At least 3 years of practical experience working with Databricks. 

  • Strong expertise in Apache Spark (PySpark), Delta Lake, SQL, and Python. 

  • Experience working on at least one hyperscaler: AWS (preferred: S3, Glue, Lambda, IAM, EC2) OR Azure / GCP. 

  • Demonstrated experience crafting and implementing end-to-end data pipelines. 

  • Exposure to AI/ML or GenAI concepts (RAG, LLMs, or model integration, Mosaic AI / DBRX). 

  • Experience in client-facing roles with strong interpersonal skills. 

  • Familiarity with modern data architecture models (Lakehouse, Medallion architecture). 

  • Familiarity with CI/CD, DevOps, and data pipeline orchestration. 

  • Knowledge of data governance and security frameworks. 

Future-Ready Skills (Nice to Have): 

  • Experience with other data engineering tools and technologies. 

  • Advanced certifications in data engineering or cloud technologies. 

  • Knowledge of new AI/ML technologies and how they apply to data engineering. 

  • Strong problem-solving abilities and proactive approach. 

Benefits 

We offer a comprehensive benefits package including Medical Insurance, PF, Gratuity, paid holidays, and more. 

We are an equal opportunity employer 

We believe that Innovative ideas and solutions start with unique perspectives. That’s why we’re committed to providing every employee a workplace that’s free of discrimination and intolerance. We’re proud to be an equal opportunity employer and actively search for like-minded people to join our team. 

 

Similar Jobs

2 Hours Ago
Remote or Hybrid
India
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, build, and operate agentic LLM-powered workflows, autonomous agents, and RAG/vector retrieval systems. Own end-to-end delivery including CI/CD, IaC, observability, DevSecOps, and Salesforce integrations to productionize enterprise AI for GTM applications.
Top Skills: AgentcoreAgentforceAutogenAws BedrockCdkCopadoCrewaiDastDockerGithub ActionsGitopsJavaScriptJenkinsKubernetesLangchainLanggraphLightning Web ComponentsModel Context Protocols (Mcp)PgvectorPineconePlatform EventsPythonSalesforce ApexSastSemantic KernelService MeshSlackTerraformTypescriptVertex AiWeaviate
2 Hours Ago
Remote or Hybrid
India
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead a distributed SRE team owning CI/CD platform reliability, automation, observability, and data infrastructure. Provide people management, technical direction, architecture input, operational excellence, and cross-team collaboration while driving automation, monitoring, and AI-assisted workflows.
Top Skills: AnsibleApache AirflowSparkAWSAzureBashBazelBitbucketChefDatadogGCPGitGithub ActionsGitlabGitlab CiGoGrafanaHumio/LogscaleJenkinsKafkaKubernetesNasNfsObject StorageOpensearchOraclePostgresPowershellPrometheusPulsarPuppetPythonRedisRedpandaSanSli/SloSplunkTerraformValleyVarnish
2 Hours Ago
Remote or Hybrid
India
Expert/Leader
Expert/Leader
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead Salesforce Engineer responsible for designing and developing Apex, LWC, Aura and Visualforce solutions, building integrations, leading Quote-to-Cash initiatives, troubleshooting L3 production issues, enforcing Salesforce best practices, participating in Agile sprints and CI/CD deployments, mentoring developers, and optimizing org and commerce process performance.
Top Skills: AgileApexAuraCi/CdIntegrationsLightning Web ComponentsQuote-To-CashSalesforceSalesforce CpqSalesforce Revenue CloudVisualforce

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account