The Senior Data Engineer will design, develop, and implement data solutions, build and optimize data pipelines, and collaborate with teams to enhance data architecture and ensure data quality and integrity.
ProArch is seeking a talented and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and implementing data solutions that tackle complex business problems. You will play a pivotal role in building data pipelines, optimizing data workflows, and collaborating with cross-functional teams to enhance our data architecture. If you are passionate about data engineering and looking for an opportunity to make a significant impact, we would love to hear from you!
Key Responsibilities:
- Design, develop, and maintain robust data pipelines to support data processing and analytics needs.
- Collaborate with data scientists, analysts, and business stakeholders to define data requirements and build solutions that meet business objectives.
- Optimize and enhance data workflows for performance and scalability.
- Implement data quality checks and validation processes to ensure data accuracy and integrity.
- Work with cloud platforms (AWS, Azure, Google Cloud) to leverage cloud-based data storage and analytics services.
- Assist in the overall data architecture strategy and best practices for the organization.
- 7+ years of experience in data engineering or related fields.
- Proficiency in programming languages such as Python, Java, or Scala.
- Strong experience with SQL database systems and NoSQL technologies.
- Hands-on experience with ETL tools and data pipeline orchestration (e.g., Apache Airflow, AWS Glue).
- Familiarity with data warehousing concepts and tools (e.g., Snowflake, Amazon Redshift).
- Experience with cloud infrastructure (e.g., AWS, Microsoft Azure, Google Cloud Platform).
- Ability to work collaboratively in a team environment and communicate effectively with technical and non-technical stakeholders.
- Strong problem-solving skills and attention to detail.
NA
Top Skills
Java
Python
Scala
Similar Jobs
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
SailPoint seeks a Senior Data Engineer to design and implement robust data ingestion and processing systems. Responsibilities include developing scalable data pipelines, integrating diverse data sources, leveraging AWS services, and using tools like Apache Airflow for orchestration. Candidates should have extensive experience in data engineering and relevant technologies.
Top Skills:
Apache AirflowAWSDockerFlinkKubernetesSpark
Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
The Senior Data Engineer at SailPoint will design and implement ELT processes for data ingestion and processing systems. Responsibilities include developing scalable data pipelines, collaborating with cross-functional teams, and utilizing AWS services to ensure efficient data solutions. The role requires strong adaptability and problem-solving skills in a dynamic environment.
Top Skills:
AWSDockerFlinkKubernetesSpark
Big Data • Fintech • Information Technology • Insurance • Financial Services
The Senior Data Engineer will design, build, and measure complex ELT jobs for processing various data sources. They will work collaboratively on projects involving batch pipelines, data modeling, and data mart solutions to implement efficient data collection and processing pipelines that meet business needs.
Top Skills:
Data Modeling
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
