Principal Data Engineer responsible for building big-data solutions using PySpark and Databricks, writing and optimizing SQL, developing Python pipelines, and working with Hadoop/Hive, Git, Airflow/Dagster, and Azure.
Requirement 1: Principal Data Engineer
Location: Remote
Experience: 6 Years
Scadea Full Time, End Client – CX Data Labs
Exp in pyspark, writng and optimizing sql queries, exp in python, hands on exp in databricks for building big data solutions, hadoop/hive, exp with data versioning tools like GIT, Airflow , Dagster, exp with azure.
Similar Jobs
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Lead business analysis for Risk Weighted Assets (RWA) and Counterparty Credit Risk (CCR) initiatives. Translate Basel III/IV and SA-CCR/IMM/EAD regulatory requirements into BRDs, FRDs, user stories, process flows and data mappings. Liaise with Market Risk, CCR, Regulatory Reporting, Finance, Quant and Technology teams to support capital calculations, RWA optimization and regulatory reporting for transformation programs.
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Support regulatory liquidity reporting by applying predefined rules and mappings, performing variance analysis and reconciliations, documenting business/functional requirements, coordinating BA/IT/testing streams, and contributing to governance, controls and audit readiness within regulatory change programmes.
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Apply predefined regulatory rules and mappings for regulatory submissions, perform variance analysis and reconciliations, and conduct regulatory impact assessments. Document business and functional requirements, support project governance and controls, and assist audit readiness and remediation. Familiarity with collateral, intraday liquidity, and reporting remediation within regulatory change programs is expected.
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
