The Senior Data Engineer will develop enterprise-class distributed data engineering solutions on the cloud, focusing on asynchronous ingestion, stream processing, and real-time analytics. The role involves defining data pipelines, identifying bottlenecks, and working closely with data scientists and engineers to create effective solutions for clients. A strong emphasis is placed on utilizing cloud technologies, particularly AWS, along with experience in various data tools and platforms.
Welcome! You made it to the job description page!
Aryng is looking for a Senior Data Engineer with experience in developing enterprise-class distributed data engineering solutions on the cloud. We are seeking an entrepreneurial and technology-proficient Senior Data Engineer who is an expert in the implementation of a large-scale, highly efficient data platform, batch, and real-time pipelines and tools for Aryng clients. This role is based out of India. You will work closely with a team of highly qualified data scientists, business analysts, and
engineers to ensure we build effective solutions for our clients. Your biggest strength is creative and effective problem-solving.
Key Responsibilities:
- Should have implement asynchronous data ingestion, high volume stream data processing, and real-time data analytics using various Data Engineering Techniques.
- Implement application components using Cloud technologies and infrastructure.
- Assist in defining the data pipelines and able to identify bottlenecks to enable the adoption of data management methodologies.
- Implementing cutting edge cloud platform solutions using the latest tools and platforms offered by GCP, AWS, and Azure. (AWS is preferred)
Functional capabilities: Requirement gathering, Client Mgt, team handling, Program delivery, Project Management (Project Estimation, Scope of Project, Agile methodology).
- 8+ years of data engineering experience is a must.
- 4+ years implementing and managing data engineering solutions using Cloud solutions GCP/AWS/Azure or on-premise distributed servers. AWS is preferred.
- Should be comfortable working and interacting with clients
- 4+ years’ experience in Python.
- Must be strong in SQL and its concepts.
- Experience in Big Query, Snowflake, Redshift, DBT.
- Strong understanding of data warehousing, data lake, and cloud concepts.
- Excellent communication and presentation skills
- Excellent problem-solving skills, highly proactive and self-driven
- Consulting background is a big plus.
- Must have a B.S. in computer science, software engineering, computer engineering, electrical engineering, or a related area of study
- Working knowledge of Airflow is preferred
Good to have:
- Experience in some of the following: Apache Beam, Hadoop, Airflow, Kafka,Spark
- Experience in Tableau, Looker, or other BI tools is preferred
This role requires mandatory overlap hours with clients in the US from 8 am to 1 pm PST.
- Direct Client Access
- Flexible work hours
- Rapidly Growing Company
- Awesome work culture
- Learn From Experts
- Work-life Balance
- Competitive Salary
- Executive Presence
- End to End Problem Solving
- 50%+ Tax Benefit
- 100% Remote company
- Flat Hierarchy
- Opportunity to become a thought leader
Why Join Aryng: Click on the
Top Skills
Python
SQL
Similar Jobs
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
SailPoint seeks a Senior Data Engineer to design and implement robust data ingestion and processing systems. Responsibilities include developing scalable data pipelines, integrating diverse data sources, leveraging AWS services, and using tools like Apache Airflow for orchestration. Candidates should have extensive experience in data engineering and relevant technologies.
Top Skills:
Apache AirflowAWSDockerFlinkKubernetesSpark
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
The Senior Data Engineer at SailPoint will design and implement ELT processes for data ingestion and processing systems. Responsibilities include developing scalable data pipelines, collaborating with cross-functional teams, and utilizing AWS services to ensure efficient data solutions. The role requires strong adaptability and problem-solving skills in a dynamic environment.
Top Skills:
AWSDockerFlinkKubernetesSpark
Big Data • Fintech • Information Technology • Insurance • Financial Services
The Senior Data Engineer will design, build, and measure complex ELT jobs for processing various data sources. They will work collaboratively on projects involving batch pipelines, data modeling, and data mart solutions to implement efficient data collection and processing pipelines that meet business needs.
Top Skills:
Data Modeling
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
