Photon Logo

Photon

Senior Data Engineer - Chennai/Banglore/Hyderabad/Trivandrum, India

Reposted One Month Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu, IND
Senior level
In-Office
Chennai, Tamil Nadu, IND
Senior level
Design, build, and optimize ELT data pipelines using Python, Airflow DAGs, and Spark in cloud environments. Convert and debug Microsoft BI ETLs into scalable big-data workflows, tune Spark resources, collaborate with business partners, and participate in Agile ceremonies with Pacific-time overlap.
The summary above was generated by AI
Greetings Everyone

 

 

 

Who are we? 

For the past 20 years, we have powered many Digital Experiences for the Fortune 500. Since 1999, we have grown from a few people to more than 4000 team members across the globe that are engaged in various Digital Modernization. For a brief 1 minute video about us, you can check https://youtu.be/uJWBWQZEA6o.



 

What will you do?     What are we looking for? 

Technical Skill set:
Having 3-5 years of experience in implementing Big Data solution in Cloud environments.
Hands-on in implenting Big data solution using Airflow DAG,Spark,Python,Hive,Trino,S3 Bucket,etc
Having experience Cloud Data platform like SnowFlake , Databricks is a plus.
Knowledge of Financial domain-Credit Card industry is a plus. 
Responsibilites:
Creating an ELT Data pipelines using python script and Airflow DAG.
Optimizing the Data pipelines by configuring the Spark system resources 
Debug an existing Microsoft BI ETLs and understand business logic and convert in to big data pipeline using Airflow DAG.
Able to interact with business partners to understand the requirements and provide technical solutions.
Proficient with Agile Methodology and active team participation is required.

Need to have overlap with Onsite team till 10-11 am Pacific time , for attending scrum ceremonies or to have onsite interaction .

Location : Offshore

Photon Chennai, Tamil Nadu, IND Office

DLF IT Park 1/124 Mount Poonamallee Road Sivaji Gardens Manapakkam , Chennai, India, 600089

Similar Jobs

14 Hours Ago
Remote or Hybrid
India
Senior level
Senior level
Digital Media • Information Technology • News + Entertainment
Designs and customizes software applications, manages releases, gathers requirements, and improves functionality and user experience. Collaborates with stakeholders, QA, and cross-functional teams to deliver reliable solutions. Tracks performance metrics, maintains technical documentation, researches industry trends, and leads development, prototyping, and design sessions. Mentors junior engineers and exercises independent judgment while supporting variable work schedules.
14 Hours Ago
Hybrid
Chennai, Tamil Nadu, IND
Junior
Junior
Digital Media • Information Technology • News + Entertainment
Develops and optimizes data structures, ingestion frameworks, ETL pipelines, warehouses, and data lakes. Ensures data quality, governance, lineage, and compliance while supporting analytics and machine learning initiatives. Designs storage solutions across on-premises and cloud platforms, manages migrations, develops APIs, monitors data flows, collaborates with technology and analytics teams, and participates in code reviews and model deployments.
Top Skills: Amazon RedshiftAPIsAws S3DatabricksETLKubernetesMinioTeradata
14 Hours Ago
Hybrid
Chennai, Tamil Nadu, IND
Mid level
Mid level
Digital Media • Information Technology • News + Entertainment
Designs and plans internal communications networks, tests and certifies network components, and ensures seamless integration and deployment. Requires expertise with Juniper and Cisco firewalls, firewall policy enforcement, network monitoring, JUNOS, Cisco IOS, and diagnostic tools. Familiarity with NetBrain, PRTG, Cisco DNA, Python, and Ansible is beneficial. The role requires a bachelor's degree, though equivalent education and experience may be considered.
Top Skills: AiopsAnsibleCheck PointCiscoCisco DnaCisco IosFortinetJuniperJunosNetbrainPrtg Network MonitorPython

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account