Lead innovative data engineering projects using advanced technologies, manage data workflows, and guide teams, while ensuring compliance and robust security practices.
🌟 Distinguished Tech Innovator:3Pillar warmly extends an invitation for you to join an elite team of visionaries. Beyond software development, we are dedicated to engineering solutions that challenge conventional norms. Envision you: steering projects that redefine urban living, establish new media channels for enterprise companies, or drive innovation in healthcare. Your invaluable expertise will serve as the cornerstone in shaping the future direction of our endeavors.This role transcends the ordinary realms of coding; it's about orchestrating technological marvels that disrupt industries. Seize this extraordinary opportunity to lead a team that is actively shaping the tech landscape for our clients, and sets global standards along the way. 🌍🔥
Minimum Qualification
- Experience: 5-8 years of experience in data engineering, DevOps, or a related technical field.
- Programming & Scripting: Strong programming skills in Python and Linux Bash for automation and data workflows.
- Framework Proficiency: Hands-on experience with Luigi for orchestrating complex data workflows.
- Data Processing & Storage: Expertise in Hadoop ecosystem tools and managing SQL databases for data storage and query optimization.
- AWS Cloud Services: In-depth knowledge of AWS EC2, S3, RDS, and EMR to deploy and manage data solutions.
- Monitoring & Alerting Tools: Familiarity with monitoring solutions for real-time tracking and troubleshooting of data pipelines.
- Communication & Leadership: Proven ability to lead projects, communicate with stakeholders, and guide junior team members.
Additional experience
- Data Architecture: Experience designing or optimizing data lake solutions.
- Security Practices: Understanding of data security practices, data governance, and compliance for secure data processing.
- Automation & CI/CD: Familiarity with CI/CD tools to support automation of deployment and testing.
- Big Data Technologies: Knowledge of big data processing tools like Spark, Hive, or related AWS services.
- Advanced Analytics: Background in analytics or data science to contribute to more data-driven decision-making.
- Cross-Functional Collaboration: Experience collaborating with non-technical teams on business goals and technical solutions.
Regards
Rajan
3Pillar Global
Top Skills
Aws Ec2
Aws Emr
Aws Rds
Aws S3
Hadoop
Hive
Linux Bash
Luigi
Python
Spark
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Develop web configuration management pipelines using Puppet, Python, and Ruby, manage hybrid cloud environments, automate testing, and research new tools.
Top Skills:
AnsibleChefLinuxPuppetPythonRubyServicenow
Artificial Intelligence • Enterprise Web • Information Technology • Productivity • Sales • Software • Database
As a Quality Engineer, you will focus on automation testing and quality assurance practices, collaborating with the engineering team to ensure product quality across various testing types and managing testing processes effectively.
Top Skills:
CucumberCypressDatadogDockerDocker ComposeGcp LoggingJavaJavaScriptKubernetesNewrelicPlaywrightPythonRspecRubySeleniumTypescript
Cloud • Information Technology • Security • Software
Join Sonar as a Developer Advocate to impact developer practices by promoting code quality and security, engaging with the coding community.
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
