Position : Sr Data Engineer.
Location : Bangalore/Hyderabad/Noida.
Immediate joiners preferred.
Required:
- Extensive experience in data engineering with a strong focus on designing and implementing complex and scalable data solutions using AWS services like MWAA and Lambda, RDS (7+ years).
- Proficient in Databricks (5+ years) using pyspark, Delta tables, Unity catalog, SQL Warehouse for optimizing data pipelines, ensuring high performance, managing big data processing tasks in an optimized manner, and writing reusable framework.
- Proficient in Snowflake (4+ years) and Snowpark for optimizing queries, schemas, and implementing security layers.
- Strong architectural knowledge coupled with RBAC concepts
- Strong SQL skills with the ability to write, optimize, and troubleshoot complex queries.
- Demonstrated problem-solving skills with the ability to analyze, diagnose, and resolve technical issues efficiently.
- Experience in developing and maintaining ETL/ELT processes to ensure data is accurately and efficiently loaded into data warehouses and data lakes.
- Knowledge of data quality frameworks, exception handling and adherence to common standards and compliance.
- Experience using CI/CD tools such as CDK, CloudFormation, and Terraform to automate deployments both IaaC and DAGs across environments.
Similar Jobs
Financial Services
As a Lead Software Engineer at JPMorgan Chase, you will design and develop technology solutions, produce architecture artifacts, analyze data for improvements, and collaborate with product and UAT teams while adhering to project timelines and promoting team diversity.
Top Skills:
AWSAzureCi/CdDatabasesFunctional ProgrammingGraphQLJavaJava 17JmsKafkaKubernetesMicroservicesReact Js FrameworkRestful WebservicesSpring Boot
Financial Services
As a Software Engineer III, you will design and implement technology solutions that align with business objectives, develop high-quality code, analyze data for improvements, and support software engineering practices while actively contributing to team culture and diversity.
Top Skills:
Cloud Based PlatformsDynatraceGeneosGrafanaJavaJira Service DeskOracleServicenowSplunk
23 Hours Ago
Easy Apply
Easy Apply
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
As a Staff Engineer at Samsara, you will lead technical direction and architecture for the Platform & Infrastructure organization. Responsibilities include developing scalable software solutions, driving technology choices, and mentoring engineers. You’ll work on impactful projects for physical operations across diverse industries, contributing to Samsara’s engineering excellence.
Top Skills:
Algorithm SolutionsAWSAzureCloud InfrastructureEngineering LeadershipGCPJavaScriptLarge-Scale Distributed SystemsSoftware DesignSoftware DevelopmentStream-ProcessingWeb Services
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
