Photon Logo

Photon

Senior Data Engineer - Chennai/Banglore/Hyderabad/Trivandrum, India

Posted 22 Days Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Design, build, and optimize ELT data pipelines using Python, Airflow DAGs, and Spark in cloud environments. Convert and debug Microsoft BI ETLs into scalable big-data workflows, tune Spark resources, collaborate with business partners, and participate in Agile ceremonies with Pacific-time overlap.
The summary above was generated by AI
Greetings Everyone

 

 

 

Who are we? 

For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check https://youtu.be/uJWBWQZEA6o.



 

What will you do?     What are we looking for? 

Technical Skill set:
Having 3-5 years of experience in implementing Big Data solution in Cloud environments.
Hands-on in implenting Big data solution using Airflow DAG,Spark,Python,Hive,Trino,S3 Bucket,etc
Having experience Cloud Data platform like SnowFlake , Databricks is a plus.
Knowledge of Financial domain-Credit Card industry is a plus. 
Responsibilites:
Creating an ELT Data pipelines using python script and Airflow DAG.
Optimizing the Data pipelines by configuring the Spark system resources 
Debug an existing Microsoft BI ETLs and understand business logic and convert in to big data pipeline using Airflow DAG.
Able to interact with business partners to understand the requirements and provide technical solutions.
Proficient with Agile Methodology and active team participation is required.

Need to have overlap with Onsite team till 10-11 am Pacific time , for attending scrum ceremonies or to have onsite interaction .

Location : Offshore

Photon Chennai, Tamil Nadu, IND Office

DLF IT Park 1/124 Mount Poonamallee Road Sivaji Gardens Manapakkam , Chennai, India, 600089

Similar Jobs

39 Minutes Ago
Hybrid
Chennai, Tamil Nadu, IND
Senior level
Senior level
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Lead API and backend web service testing: write and execute test cases, investigate defects and logs, maintain and expand automation and regression suites, enhance continuous testing and build pipeline jobs, and collaborate with engineers and product owners to ensure production quality.
Top Skills: GrafanaHarnessJIRAOracle DbReadyapiRestSoapSplunkSpotfireSQLSvn
3 Hours Ago
Remote or Hybrid
India
Senior level
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Design, build, and operate agentic LLM-powered workflows, autonomous agents, and RAG/vector retrieval systems. Own end-to-end delivery including CI/CD, IaC, observability, DevSecOps, and Salesforce integrations to productionize enterprise AI for GTM applications.
Top Skills: AgentcoreAgentforceAutogenAws BedrockCdkCopadoCrewaiDastDockerGithub ActionsGitopsJavaScriptJenkinsKubernetesLangchainLanggraphLightning Web ComponentsModel Context Protocols (Mcp)PgvectorPineconePlatform EventsPythonSalesforce ApexSastSemantic KernelService MeshSlackTerraformTypescriptVertex AiWeaviate
6 Hours Ago
Hybrid
Chennai, Tamil Nadu, IND
Mid level
Mid level
Digital Media • Information Technology • News + Entertainment
Develop and maintain enterprise-scale ServiceNow solutions (ITSM, CMDB, TSOM), implement integrations and automation, support data migration, production support, testing, vulnerability remediation, and apply DevSecOps practices while working with architects, senior developers, and business partners.
Top Skills: APIsCloud FundamentalsCRMDatabasesDevsecopsErpFlow DesignerJavaJavaScriptNow AssistOss/BssPythonRest ApisSaaSScript IncludesService PortalServicenowServicenow CmdbServicenow ItsmTelecom Order ManagementTniTsom

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account