The Big Data Engineer will support existing applications and work on new design and implementation requirements, utilizing big data technologies and tools.
This is a remote position.
Role: Big Data Engineer/Developer
Experience: 3-6 Years in Big Data
Immediate Joiners: Preferred
Location: Remote( for now)
Job Description:
- Data Engineer required with experience working in Hadoop in technologies including Hive, Hdfs, Sqoop etc.
- Must have - Python, Pyspark, Spark, AWS/Azure, SQL.
- Candidate will perform the role of senior developer where he needs to support existing applications as well as work on new requirements from a design and implementation perspectives.
- GitLab Hadoop Hive Jenkins MAVEN Nexus
- Scala Shell Scripting YARN Oracle Scrum/Agile Spring.
- Sound communication skills - both written and verbal
- Good to have - Knowledge of Teradata, Airflow, GCP
Similar Jobs
Blockchain • Fintech • Software • Cryptocurrency • Metaverse
Support and optimize large-scale Spark/YARN jobs and storage (S3/EMR). Build job-profiling, cost-analysis, AI-assisted automation, monitoring/alerting (Prometheus, Flink/Spark), and internal ops tooling to improve stability and reduce costs.
Top Skills:
ChatgptClaudeCopilotCursorLinuxPython
Agency • Information Technology
Senior Java engineer responsible for building data lake and big data solutions (preferably on Spark) with cloud experience (Azure/AWS/GCP), REST services, OOA/OOD and JEE design patterns, PostgreSQL expertise, TDD practices, and working in Agile teams. Optional: front-end (Angular/React), Docker/Kubernetes, investment banking domain knowledge.
Top Skills:
AngularSparkAWSAzureBddData LakeDockerGCPJavaJeeKubernetesMockingPostgresReactRestUnit Testing
Information Technology
The Big Data Engineer will design and develop scalable data solutions, build data pipelines, ensure data quality, and collaborate across teams.
Top Skills:
SparkAWSAzureBigQueryDockerGCPHadoopHdfsJavaKafkaKubernetesPythonS3Scala
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
