The Data Engineer will design and develop solutions for complex data problems, build big data analytics workflows, and deploy machine learning models. The role requires proficiency in big data technologies and a strong grasp of distributed computing frameworks, and cloud platforms.
It's fun to work in a company where people truly BELIEVE in what they are doing!
We're committed to bringing passion and customer focus to the business.
The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems and in building end-to-end productionized MLOps pipelines.
RESPONSIBILITIES:
- Our Big Data capability team needs hands-on developers who can produce beautiful & functional code to solve complex analytics problems. If you are an exceptional developer with an aptitude to learn and implement using new technologies, and who loves to push the boundaries to solve complex business problems innovatively, then we would like to talk with you.
- You would be responsible for evaluating, developing, maintaining, and testing big data solutions for advanced analytics projects.
- The role would involve big data pre-processing & reporting workflows including collecting, parsing, managing, analyzing and visualizing large sets of data to turn information into business insights.
- The role would also involve testing various machine learning models on Big Data and deploying learned models for ongoing scoring and prediction. An appreciation of the mechanics of complex machine learning algorithms would be a strong advantage.
QUALIFICATIONS:
- Demonstrable experience designing technological solutions to complex data problems, developing & testing modular, reusable, efficient and scalable code to implement those solutions.
- Ideally, this would include work on the following technologies:
- Expert-level proficiency in at-least one of Java, C++, or Python (preferred). Scala knowledge a strong advantage
- Strong understanding and experience in distributed computing frameworks, particularly Apache Hadoop 2.0 (YARN; MR & HDFS) and associated technologies -- one or more of Hive, Sqoop, Avro, Flume, Oozie, Zookeeper, etc.
- Hands-on experience with Apache Spark and its components (Streaming, SQL, MLLib) is a strong advantage.
- Operating knowledge of cloud computing platforms (AWS, especially EMR, EC2, S3, SWF services and the AWS CLI)
- Experience working within a Linux computing environment, and use of command line tools including knowledge of shell/Python scripting for automating common tasks.
- Ability to work in a team in an agile setting, familiarity with JIRA and clear understanding of how Git works.
- Linux environment and shell scripting
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
Top Skills
C++
Java
Python
Scala
Fractal Chennai, Tamil Nadu, IND Office
Chennai, Tamil Nadu, India, 600034
Similar Jobs
As a Data Engineer at Atlassian, you will build and maintain data lakes, improve data pipelines, and develop micro-services to support business growth. You will collaborate with stakeholders to enhance data ingest processes and ensure effective data management, working with technologies like AWS, Spark, and Airflow.
Be an Early Applicant
As a Lead Software Engineer, you will design, develop and maintain secure software solutions that enhance business capabilities. You'll produce design artifacts, collaborate with teams, analyze data for reporting, and participate in agile ceremonies. Your role includes troubleshooting complex database solutions and promoting a culture of diversity and inclusion.
As a DevOps Engineer, you'll build cloud infrastructure using Infrastructure as Code, drive automation of CI/CD processes, support developed automations, and ensure system availability. Collaborate with teams for architectural discussions, and maintain security and performance of infrastructure.
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
