As a Senior Data Engineer, you'll design data pipelines for large cybersecurity datasets, collaborate with teams, and implement web services and APIs.
ABOUT THIS ROLE
As a senior data engineer you will work on complex data pipelines dealing with petabytes of data. Balbix platform is used as one of the critical security tools by the CIOs, CISOs, and the sec-ops teams of small, medium and large sized enterprises including Fortune 10 companies around the world. You will solve problems related to massive cybersecurity and IT data sets. You will collaborate closely with our data scientists, threat researchers and network experts to solve real-world problems plaguing cybersecurity. This role requires excellent algorithm, programming and testing skills as well as experience in large-scale data engineering projects.
You will:
- Design and implement the features and own the modules for ingesting, storing and manipulating large data sets for a variety of cybersecurity use-cases
- Write code to provide backend support for data-driven UI widgets, web dashboards, workflows, search and API connectors
- Design and implement web services, rest APIs, and microservices
- Build production quality solutions that balance complexity and meet acceptance criteria of functional requirements
- Work with multiple-interfacing teams, including ML, UI, backend and data engineering
You are:
- Driven to experience and learn more about design, architecture, and take on progressive roles
- Collaborative and comfortable working with across teams including data engineering, front end, product management, and DevOps
- Responsible and like to take ownership of challenging problems
- An effective communicator, including good documentation practices and articulating thought processes in a team setting
- Comfortable with working in an agile environment
- Curious about technology and the industry, and a constant learner
You have:
- MS/BS +3 years in Computer Science or a related field
- Expert programming experience with Python, Java, or Scala
- Good working knowledge of SQL databases such as Postgres and NoSQL databases such as MongoDB, Cassandra, Redis
- Experience with search engine database such as ElasticSearch is preferred
- Time-series databases such as InfluxDB, Druid, Prometheus
- Strong computer science fundamentals: data structures, algorithms, and distributed systems
Top Skills
Cassandra
Druid
Elasticsearch
Influxdb
Java
MongoDB
Postgres
Prometheus
Python
Redis
Scala
SQL
Similar Jobs
Information Technology
The Data Engineer will design and maintain cloud-native data pipelines, collaborating with cross-functional teams to enhance data solutions and ensure efficient data management.
Top Skills:
BigQueryCloud StorageDagsterDbtGoogle Cloud PlatformPub/SubPythonSQL
Software
As a Solutions Engineer at DevRev, you will design and implement technical solutions for clients, collaborating with various stakeholders, conducting product demonstrations, and providing technical support. You'll create technical proposals, analyze competitors, train sales teams, and ensure smooth transitions for new customers.
Information Technology
As a Senior Backend Engineer, you'll design scalable backend systems, develop APIs, collaborate with frontend teams, and ensure code quality using TypeScript and NestJS while mentoring others.
Top Skills:
AlgoliaCi/CdGithub ActionsGoogle Cloud PlatformJwtNestjsNextjsOauthOrmReactRestSQLTerraformTypescript
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
