Senior Big Data engineer role requiring design and development of scalable data pipelines and ETL using Spark and Scala/Python on AWS EMR, with experience integrating Oracle databases and working in Unix environments.
Location: Bangalore
Experience: 6-9 Years
Spark, Scala, Python, EMR, Oracle, Unix
Photon Chennai, Tamil Nadu, IND Office
DLF IT Park 1/124 Mount Poonamallee Road Sivaji Gardens Manapakkam , Chennai, India, 600089
Similar Jobs
Enterprise Web • Mobile • Professional Services • Software
Build and improve production LLM agents and AI features through evaluation, experimentation, observability, prompting, context engineering, tool use, and workflow design. Develop backend services, APIs, data models, and feedback pipelines that make agent behavior reliable and measurable. Investigate performance issues, run staged rollouts and production replays, define quality standards, and partner with Product, Data Science, and Sales to deliver business outcomes with appropriate privacy, security, and human-oversight safeguards.
Top Skills:
Agentic WorkflowsAPIsBackend ServicesBraintrustClaude CodeCursorData ModelsDatadog Llm ObservabilityEvaluation HarnessesGithub CopilotLangchainLanggraphLangsmithLlm-As-JudgeLlm-Based SystemsMcp
Enterprise Web • Mobile • Professional Services • Software
Own the AI product roadmap from discovery through launch and iteration. Define model evaluation standards, failure modes, rollback plans, and agent-autonomy boundaries. Prototype and ship production AI features, influence architecture, and apply prompting and context design. Collaborate with Design, Research, Engineering, Sales, Marketing, and Customer Success while tracking quality, latency, cost, adoption, and growth metrics.
Top Skills:
AIBraintrustClaudeCodexCursorLangsmithLlmsOpenclaw
Enterprise Web • Mobile • Professional Services • Software
Build and own full-stack product features from ambiguous problems through deployment. Partner with Product and Design, make UX decisions, integrate LLM and agent capabilities into trustworthy product experiences, talk with users, instrument releases, and iterate based on usage. The role requires strong product judgment, user empathy, independent execution, and comfort using AI coding tools while collaborating with AI engineers on model behavior.
Top Skills:
Claude CodeCursorGithub CopilotLlm AgentsLlm ApisPrompting
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

