Principal Data Engineer responsible for building big-data solutions using PySpark and Databricks, writing and optimizing SQL, developing Python pipelines, and working with Hadoop/Hive, Git, Airflow/Dagster, and Azure.
Requirement 1: Principal Data Engineer
Location: Remote
Experience: 6 Years
Scadea Full Time, End Client – CX Data Labs
Exp in pyspark, writng and optimizing sql queries, exp in python, hands on exp in databricks for building big data solutions, hadoop/hive, exp with data versioning tools like GIT, Airflow , Dagster, exp with azure.
Similar Jobs
Digital Media • Information Technology • News + Entertainment
Design, build, and optimize CI/CD pipelines, automate deployments and infrastructure, monitor application performance, and improve collaboration between development and operations to create stable, scalable systems.
Digital Media • Information Technology • News + Entertainment
Supervise and develop an ad operations team (10+), ensure ad operations deadlines and policies are met, resolve escalations with sales, analyze verification and revenue issues, revise procedures, coach staff, and support special projects to scale operations.
Digital Media • Information Technology • News + Entertainment
Triage and root-cause analysis of field issues on RDK-based CPE devices using Linux/C/C++. Analyze device logs and machine metrics (Elastic, Splunk, Datadog), reproduce defects, provide deep source-code analysis, guide development teams, design automation for detection/triage, and lead technical activities and team improvements.
Top Skills:
CC++DatadogElasticLinuxNetworkingRdkvSplunkWifi
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
