3Pillar Global
Senior Data Engineer with Exp in Snowflake & Amazon QuickSight(5+ Years of Exp)
Be an Early Applicant
The Senior Data Engineer will design and optimize ETL/ELT pipelines, manage data integration, perform data validation, and support reporting solutions using various technologies.
At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective Industries. if your passion for data analytics solutions that make a real-world impact, consider this your pass to the captivating world of Data Science and Engineering! 🔮🌐
Key Responsibilities
- Design, develop, and optimize scalable ETL/ELT pipelines for enterprise data platforms
- Build and maintain robust data solutions using Snowflake, Python, and AWS services
- Develop advanced SQL queries using CTEs, window functions, query tuning, and performance optimization techniques
- Work with Snowflake warehouses, tasks, streams, and data pipelines for efficient data processing
- Create and maintain data transformation workflows using dbt (data build tool)
- Develop reporting datasets and support dashboarding solutions using Amazon QuickSight
- Perform data validation, data integrity checks, and root cause analysis to ensure data accuracy and reliability
- Integrate and manage data across platforms including DynamoDB, S3, AWS Glue, Lambda, and Rockset
- Collaborate with cross-functional teams including analytics, product, and clinical stakeholders to support reporting requirements
- Monitor pipeline performance and troubleshoot production data issues
Required Skills
- Strong experience in SQL including:
- CTEs
- Window Functions
- Query Optimization
- Performance Tuning
- Hands-on experience with Snowflake:
- Warehouses
- Streams
- Tasks
- Data Loading and Optimization
- Experience in Python for data processing and pipeline development
- Experience with AWS services:
- AWS Glue
- Lambda
- S3
- Good knowledge of dbt (Data Build Tool)
- Experience in creating dashboards and reports using Amazon QuickSight
- Knowledge of Rockset analytical engine
- Experience with DynamoDB and NoSQL databases
- Basic to intermediate knowledge of JavaScript
Similar Jobs
Retail • Software
The Senior Data Engineer - II will design data pipelines, optimize ETL workflows, manage databases, and support Power BI reporting for business decisions.
Top Skills:
AWSBigQueryGCPMySQLPostgresPower BIPythonSnowflakeSQL
Healthtech
As a Data Engineer, you will design and optimize data architectures, develop ETL pipelines, collaborate with finance teams, and enable advanced analytics while ensuring data governance and process efficiency.
Top Skills:
AzureEltETLPower BIPythonSnowflakeSparkSQL
Fintech • Real Estate • Software
As a Senior Data Engineer, you'll design data models, build ETL/ELT pipelines, collaborate with other engineers, and enhance analytics products to support business decisions.
Top Skills:
Amazon RedshiftAWSBiData StudioDomoGoogle BigqueryLookerModePostgresPower BIPythonQlikviewSnowflakeSQLTableau
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
