The Big Data Engineer will support existing applications and work on new design and implementation requirements, utilizing big data technologies and tools.
This is a remote position.
Role: Big Data Engineer/Developer
Experience: 3-6 Years in Big Data
Immediate Joiners: Preferred
Location: Remote( for now)
Job Description:
- Data Engineer required with experience working in Hadoop in technologies including Hive, Hdfs, Sqoop etc.
- Must have - Python, Pyspark, Spark, AWS/Azure, SQL.
- Candidate will perform the role of senior developer where he needs to support existing applications as well as work on new requirements from a design and implementation perspectives.
- GitLab Hadoop Hive Jenkins MAVEN Nexus
- Scala Shell Scripting YARN Oracle Scrum/Agile Spring.
- Sound communication skills - both written and verbal
- Good to have - Knowledge of Teradata, Airflow, GCP
Similar Jobs
.png)
Big Data • Machine Learning • Software • Analytics • Big Data Analytics
The Senior Big Data Engineer will manage customer engagements, develop big data architectures, and guide clients in utilizing the Databricks platform effectively.
Top Skills:
SparkAWSAzureDatabricksGCPKafkaPythonScala
Fintech • Financial Services
The Data Engineer will design, develop, and maintain data pipelines and solutions, ensuring data quality and collaborating with cross-functional teams to meet analytics needs.
Top Skills:
Apache AirflowSparkAWSAzureDockerDynamoDBGCPGitHadoopJavaJenkinsKafkaKubernetesLuigiMongoDBMySQLNode.jsPostgresPythonTerraform
Artificial Intelligence • Machine Learning • Security • Software • Analytics • Big Data Analytics
Support enterprise big data infrastructure deployments, provide customer site support, manage installations and upgrades, develop automation scripts, and enhance monitoring tools.
Top Skills:
AnsibleApache KafkaSparkApache ZookeeperBashHarborHdfsJenkinsKubernetesLonghornOpen ShiftPythonRedhat LinuxRkeVmware VsphereYarn
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
