Black Box Logo

Black Box

Data Engineer

Posted 15 Days Ago
Remote
Hiring Remotely in India
Entry level
Remote
Hiring Remotely in India
Entry level
The description indicates a payroll-focused analyst role within the Payroll team, but provides no specific responsibilities, qualifications, technologies, salary, travel, or clearance requirements.
The summary above was generated by AI

Job Title: Associate Data Engineer

Job Type: Full-time

Experience Level: Fresher (1-4 Years)

About the Role:

We are looking for an enthusiastic and detail-oriented Associate Data Engineer to join our growing data team. If you are a recent graduate passionate about data and eager to build a career in data engineering, this is the perfect opportunity for you!

In this role, you will work closely with senior engineers to build, maintain, and optimize data pipelines. You will get hands-on experience with modern data infrastructure, transitioning your basic academic or project-level knowledge into production-grade skills. We focus heavily on mentorship, ensuring you have the support you need to grow as a professional.

Key Responsibilities:

  • Pipeline Development: Assist in writing and maintaining ETL (Extract, Transform, Load) scripts to move data across various systems.
  • Database Management: Write basic SQL queries, create tables, and interact with PostgreSQL databases to support data storage and retrieval.
  • Data Orchestration: Help schedule, monitor, and troubleshoot automated data workflows using Apache Airflow.
  • Stream Processing: Collaborate with the team to build and monitor real-time or near-real-time data streaming applications using Apache Flink.
  • Coding & Debugging: Write clean, readable, and well-documented code in Python.
  • Continuous Learning: Actively participate in code reviews, learn best practices from senior team members, and stay updated on the latest data engineering trends.

Must-Have Qualifications:

  • Education: Bachelor’s or Master’s degree in Computer Science, IT, Data Science, Mathematics, or a related field (Recent graduates from batch [Year] are welcome).
  • Python: Solid foundational knowledge of Python programming (data structures, loops, functions, basic libraries like Pandas).
  • PostgreSQL (SQL): Basic understanding of relational databases, table design, and the ability to write standard SQL queries (SELECT, JOINs, GROUP BY).
  • Apache Airflow: Theoretical understanding or project-level exposure to how Airflow works (DAGs, tasks, scheduling).
  • Apache Flink: Basic conceptual knowledge of distributed data processing or stream processing using Flink.
  • Soft Skills: Strong analytical thinking, problem-solving skills, and a genuine eagerness to learn and adapt to new technologies.

Good-to-Have (Bonus Points):

  • Spatial Data: Knowledge of the PostGIS extension for PostgreSQL and a basic understanding of how to write geo/spatial queries.
  • Version Control: Basic understanding of tools like Git/GitHub.
  • Cloud Basics: Familiarity with cloud platforms (AWS, GCP, or Azure).
  • OS: Comfortable with basic Linux/Unix command-line operations.
  • Portfolio: Any personal or academic projects showcasing data pipelines or data processing.

Similar Jobs

3 Days Ago
In-Office or Remote
Entry level
Entry level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Principal Software Engineer role focused on building and developing Atlassian’s Trusted Data Platform. The position is full-time and based in Bengaluru, India, with remote flexibility. The provided description emphasizes Atlassian’s distributed-first work model, virtual interviews and onboarding, and location flexibility for eligible employees.
5 Days Ago
In-Office or Remote
Mid level
Mid level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and operate Atlassian’s high-scale data platform across streaming ingestion and MPP query systems. Develop production-quality code, own features and fixes, participate in on-call support, debug production issues, tune performance and data quality, review code, document systems, and collaborate with partner teams. The role requires distributed-systems fundamentals, strong programming skills, cloud data infrastructure experience, and familiarity with Flink or MPP query engines.
Top Skills: Apache DorisApache PinotAWSDruidFlinkGCPJavaPythonScalaStarrocksTrino
Yesterday
Remote
India
Mid level
Mid level
Artificial Intelligence • HR Tech • Professional Services • Software
Design, build, and maintain scalable ETL pipelines, data warehouses, data lakes, and analytics platforms. Develop Streamlit dashboards, integrate PostHog behavioral data, create LangChain workflows, and use deepeval for model validation. Optimize SQL and database schemas, ensure data quality, governance, security, and privacy, monitor pipeline health, troubleshoot failures, and collaborate with data scientists and cross-functional teams.
Top Skills: BigQueryDeepevalLangchainPostgresPosthogPythonSnowflakeSQLStreamlit

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account