BigID Logo

BigID

Data Platform Engineer

Posted 2 Days Ago
Be an Early Applicant
Chennai, Tamil Nadu
Senior level
Chennai, Tamil Nadu
Senior level
The Data Platform Engineer will design, develop, maintain, and troubleshoot ETL processes while collaborating with cross-functional teams. Responsibilities include overseeing code reviews, ensuring software quality, and implementing scalable data solutions using technologies such as NodeJS, Snowflake, and AWS S3.
The summary above was generated by AI

Who we are:

BigID is an innovative tech startup that focuses on solutions for data security, compliance, privacy, and AI data management. We're leading the market in all things data: helping our customers reduce risk, drive business innovation, achieve compliance, build customer trust, make better decisions, and get more value from their data.

We are building a global team passionate about innovation and next-gen technology. BigID has been recognized for: 

  • BigID Named Hot Company in Artificial Intelligence and Machine Learning at the 2024 Global InfoSec Awards
  • Citizens JMP Cyber 66 List of Hottest Privately Held Cybersecurity Companies
  • CRN 100 list named BIgID as one of the 20 Coolest Identity Access Management And Data Protection Companies Of 2024 (2 years running)
  • DUNS 100 Best Tech Companies to Work For in 2024
  • Top 3 Big Data and AI Vendors to Watch' in the 2023 BigDATAwire Readers and Editors Choice Awards
  • 2024 Inc. 5000 list for the 4th consecutive year!
  • Shortlisted for the 2024 AI Awards in the category of Best Use of AI in Cybersecurity

At BigID, our team is the foundation of our success. Join a people-centric culture that is fast-paced and rewarding: you’ll have the opportunity to work with some of the most talented people in the industry who value innovation, diversity, integrity, and collaboration.

Who we seek:

We’re looking for a Data Platform Engineer to join our ETL team. The ideal candidate will have experience with data engineering to design and maintain our ETL pipelines. You will work closely with cross-functional teams to ensure the scalability and reliability of our data solutions.

Job Summary:

As a Data Platform Engineer, you'll be responsible for the design, development, maintenance, troubleshooting, and implementation of our ETL processes. 

What you’ll do:

  • Maintain current solutions based on NodeJS, Snowflake and AWS S3
  • Implement data processing pipelines using Kafka for real-time data streaming.
  • Collaborate with product managers, data analysts, and other stakeholders to gather requirements and translate them into technical specifications.
  • Oversee code reviews, ensure best practices in coding and data handling, and maintain high-quality standards in software development.
  • Stay up-to-date with emerging trends and technologies in big data and recommend improvements to our architecture and processes.
  • Troubleshoot and resolve issues promptly to minimize downtime and ensure system reliability.

What you’ll bring:

  • Bachelor’s degree in Computer Science, Engineering, or a related field; Master’s degree preferred.
  • 5+ years of experience in the software engineering field.
  • Proficiency in NodeJS programming and experience with related frameworks.
  • Proficiency in Java programming and experience with related frameworks.
  • Understanding of data modelling, ETL processes, and data warehousing. 
  • Strong knowledge of SQL.
  • Problem-solving abilities and strong analytical skills.
  • A solid understanding of CI/CD principles.
  • Experience working with both external and in-house APIs and SDKs Advantages:
  • Experience with Docker, Kubernetes
  • Experience with cloud platforms (e.g., AWS or Azure)
  • Full-stack experience is a plus

What’s in it for you?!

Our people are the foundation of our success, and we prioritize offering a wide range of benefits that make our team happier and healthier.

  •    Equity participation - everyone shares in our success
  •    Hybrid work 
  •    Opportunities for professional growth
  •    Team fun & company outings
  •    Statutory benefits and leave benefits
  •    Health Insurance coverage 

Our Values:

We look for people who embody our values - Care, Do, Try & Shine.

  • Care - We care about our customers and each other
  • Do - We do what it takes to make a positive impact
  • Try- We try our best and we don’t give up
  • Shine- We shine and make it our mission to always stand out

#LI-Hybrid

#LI-EV2

BigDiversity: We’re committed to creating a culture of inclusion, diversity, and equality – across race, gender, sexuality, disability, and neurodiversity – where innovation and growth thrive, every voice is heard, and everybody belongs. Learn more about us here.

CPRA Employee Privacy Notice: CA 

BigID is an E-Verify Participant.

Top Skills

Java
Node.js
SQL

Similar Jobs

18 Days Ago
Easy Apply
Hybrid
Chennai, Tamil Nadu, IND
Easy Apply
Mid level
Mid level
Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
As a Data Platform Engineer, you will design and build a self-service data infrastructure for Udemy's data mesh. You'll create scalable data pipelines using AWS services and tools like Airflow and Kafka, and contribute to data quality and privacy initiatives. You will work collaboratively in a dynamic environment focused on innovation.
Top Skills: JavaPythonScala
2 Days Ago
Chennai, Tamil Nadu, IND
Expert/Leader
Expert/Leader
Big Data • Information Technology • Machine Learning • Sales • Software • Database • Generative AI
The Principal Software Engineer will design and build a scalable data platform, manage data pipelines, and lead the development of data solutions while collaborating with various teams to identify data needs and improve data processes.
Top Skills: AWSGCPPythonSQL
24 Days Ago
Remote
Chennai, Tamil Nadu, IND
Junior
Junior
Insurance • Software • Energy • Financial Services
As a Data Platform Engineer, you will monitor production processes, manage incident tickets, and ensure smooth operations in data platforms. Responsibilities include production monitoring, incident management, and platform support, focusing on improving workflows and system reliability.
Top Skills: PythonSQL

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account