Design and maintain data pipelines and warehouses, optimize data models in Snowflake, develop ETL/ELT processes, and collaborate with stakeholders to ensure data quality and compliance.
3Pillar warmly extends an invitation for you to join an elite team of visionaries. Beyond software development, we are dedicated to engineering solutions that challenge conventional norms. Envision you: steering projects that redefine urban living, establish new media channels for enterprise companies, or drive innovation in healthcare. Your invaluable expertise will serve as the cornerstone in shaping the future direction of our endeavours. This role transcends the ordinary realms of coding; it's about orchestrating technological marvels that disrupt industries. Seize this extraordinary opportunity to lead a team that is actively shaping the tech landscape for our clients and sets global standards along the way. 🌍
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines and data warehouses
- Build and optimize data models in Snowflake for analytics and reporting
- Develop ETL/ELT processes using Python and modern data tools
- Implement and manage data solutions on AWS (S3, Redshift, Glue, Lambda, etc.)
- Ensure data quality, reliability, and performance across systems
- Collaborate with data analysts, data scientists, and business stakeholders
- Troubleshoot and resolve data-related issues
- Follow best practices for data security, governance, and compliance
Required Qualifications:
- 5+ years of experience as a Data Engineer
- Strong hands-on experience with Snowflake
- Proficiency in Python for data processing and automation
- Solid experience with AWS cloud services
- Experience with SQL and data modeling
- Knowledge of ETL/ELT frameworks and data warehousing concepts
- Strong problem-solving and communication skills
Preferred Qualifications:
- Experience with orchestration tools (Airflow, Step Functions, etc.)
- Familiarity with CI/CD pipelines
- Experience in Agile/Scrum environments
Regards
Rajan Paul(Linkedin Profile)
3Pillar Global
Top Skills
AWS
Python
Snowflake
SQL
Similar Jobs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Data Engineer, you will create data pipelines, ensure data quality, develop data governance, and coach junior engineers while collaborating with product managers and business teams.
Top Skills:
AirflowAmazon Web ServicesDatabricksEmrHiveJavaKinesisPythonRdsS3ScalaSparkSQLSqs
Financial Services
As a Software Engineer II, you'll design and develop components while troubleshooting applications and ensuring code quality. You'll work with ETL tools and cloud platforms and contribute to team culture.
Top Skills:
AbinitioAirflowAWSAzureAzure DevopsDeltaDockerGCPGitGithub ActionsJavaOrcParquetPrefectPysparkPythonSQL
Consulting
Responsible for designing, developing, and maintaining data pipelines, ensuring data quality, writing complex SQL queries, and collaborating with team members.
Top Skills:
Ab InitioAirflowAWSAzureDatabricksDbtFivetranGCPKafkaMatillionPower BIPrefectPythonRedshiftShellSnowflakeSpark StreamingSQLTableauTalend
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
