Cloud Data Engineer will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling, SQL knowledge is a must with Python programming background. The Data Engineer will be responsible for providing design and development solutions for applications in the cloud.
ESSENTIAL DUTIES AND RESPONSIBILITIES
- Understand requirements and engage with team to design and deliver projects.
- Design and implement data lake house projects within azure.
- Design and develop application lifecycle utilizing Microsoft Azure technologies
- Participate in design and planning and necessary documentation
- Participate in Agile ceremonies including daily standups, scrum, retrospectives, demos, code reviews.
- Hands on with Python/SQL development and Azure data pipelines
- Engage with team to develop and deliver cross functional products
EDUCATION AND/OR EXPERIENCE
- Bachelor's degree in CS.
- 7 years of hands-on experience in designing and developing distributed data pipelines.
- 5 years of hands-on experience in Azure data service technologies.
- 5 years of hands-on experience in Python, SQL, Object oriented programming, ETL and unit testing
- Experience with data integration with APIs, Web services, Queues
- Experience with Azure DevOps and CI/CD as well as agile tools and processes including JIRA, confluence.
- · Key Skills
- a. Data Engineering and SQL
- b. Python
- c. PySpark
- d. Azure Data lake and ADF
- e. Databricks
- f. CICD
- g. Strong communication
About us
Whether it’s awareness, advocacy, engagement, or efficacy, we move brands forward with work that connects with audiences and delivers results. Through meaningful analytics, engaging communications and innovative technology solutions, we help clients tackle their most ambitious projects and overcome their biggest challenges.
We are an equal opportunity employer
We believe that Innovative ideas and solutions start with unique perspectives. That’s why we’re committed to providing every employee a workplace that’s free of discrimination and intolerance. We’re proud to be an equal opportunity employer and actively search for like-minded people to join our team.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform job functions, and to receive benefits and privileges of employment. Please contact us to request accommodation.
- Document and maintain project artifacts.
- Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
- Complete training as required for Privacy, Code of Conduct etc.
- Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
- Adhere to the company's compliance program.
- Safeguard the company's intellectual property, information, and assets.
- Other duties as assigned.
