Zealogics LLC
Senior Data Engineer- Tech Lead (immediate role)
Sorry, this job was removed
Be an Early Applicant
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Senior SDET, you'll develop test strategies, automate tests, validate features, and optimize CI/CD pipelines while collaborating with data science teams.
Top Skills:
AWSAzureBitbucketC++DockerGCPGitJenkinsPythonRust
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As a Senior Software Engineer, you will develop software for file format parsing, collaborate on machine learning features, and maintain systems while ensuring quality and optimization.
Top Skills:
AWSAzureBitbucketC++GCPGitJenkinsJIRALinuxmacOSPythonRustWindows
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
As an Automation Engineer, you'll design and implement workflow automations across various functions to improve operational efficiency and security while mentoring others in automation practices.
Top Skills:
AnsibleGithub ActionsJavaScriptJenkinsJSONLow-Code PlatformsOauthPower AutomatePythonRest ApisServicenowTerraformXML
Responsibilities
- Able to participate in business discussions and assist gathering data requirements. Good analytical and problem-solving skills to help address data challenges by leading a team
- Proficiency in writing complex SQL queries for data extraction, transformation, and analysis. Knowledge of SQL functions, joins, subqueries, and performance tuning. Able to navigate source systems with minimal guidance to understand how data is related and use like data profiling to gain a better understanding of the data. Hands on experience with PySQL/Pyspark etc.
- Hands on Experience in creating and managing data pipelines using Azure Data Factory. Understanding of data integration, transformation, and workflow orchestration in Azure environments.
- Knowledge of data engineering workflows and best practices in Databricks. Able to understand existing templates and patterns for development. Hands on experience with Unity Catalog and Databricks workflow.
- Proficiency in using Git for version control and collaboration in data projects. Ability to work effectively in a team environment, especially in agile or collaborative settings.
- Clear and effective communication skills to articulate findings and recommendations for other team members. Ability to document processes, workflows, and data analysis results effectively.
- Willingness to learn new tools, technologies, and techniques as the field of data analytics evolves. Being adaptable to changing project requirements and priorities.
Skills
- 9+ years of overall experience with more than 7+ years of expertise in Azure technologies
- Ability to envision/lead E2E solution and solve technical issue during offshore.
- Azure Databricks, Data Lakehouse architectures, and Azure Data Factory.
- Expertise in optimizing data workflows and predictive modeling.
- Designing and implementing data pipelines using Databricks, Spark,
- Expertise in batch and streaming data solutions, automating workflows with CI/CD tools like Jenkins and Azure DevOps, and ensuring data governance with Delta Lake
- Spark, PySpark, Delta Lake, Azure DevOps, Python.
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
