The Senior Data Engineer will create and maintain data solutions, model data for stakeholders, enhance data quality, and ensure reliable data practices.
Working at Atlassian
Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Team: Core Engineering Reliability Team
Minimum Qualifications / Your background:
Desirable Qualifications
Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity. Interviews and onboarding are conducted virtually, a part of being a distributed-first company.
Team: Core Engineering Reliability Team
- Collaborate with engineering and TPM leaders, developers, and process engineers to create data solutions that extract actionable insights from incident and post-incident management data, supporting objectives of incident prevention and reducing detection, mitigation, and communication times.
- Work with diverse stakeholders to understand their needs and design data models, acquisition processes, and applications that meet those requirements.
- Add new sources, implement business rules, and generate metrics to empower product analysts and data scientists.
- Serve as the data domain expert, mastering the details of our incident management infrastructure.
- Take full ownership of problems from ambiguous requirements through rapid iterations.
- Enhance data quality by leveraging and refining internal tools and frameworks to automatically detect issues.
- Cultivate strong relationships between teams that produce data and those that build insights.
Minimum Qualifications / Your background:
- BS in Computer Science or equivalent experience with 8+ years as a Senior Data Engineer or similar role
- 10+ Years of progressive experience in building scalable datasets and reliable data engineering practices.
- Proficiency in Python, SQL, and data platforms like DataBricks
- Proficiency in relational databases and query authoring (SQL).
- Demonstrable expertise designing data models for optimal storage and retrieval to meet product and business requirements.
- Experience building and scaling experimentation practices, statistical methods, and tools in a large scale organization
- Excellence in building scalable data pipelines using Spark (SparkSQL) with Airflow scheduler/executor framework or similar scheduling tools.
- Expert experience working with AWS data services or similar Apache projects (Spark, Flink, Hive, and Kafka).
- Understanding of Data Engineering tools/frameworks and standards to improve the productivity and quality of output for Data Engineers across the team.
- Well versed in modern software development practices (Agile, TDD, CICD)
Desirable Qualifications
- Demonstrated ability to design and operate data infrastructure that deliver high reliability for our customers.
- Familiarity working with datasets like Monitoring, Observability, Performance, etc..
Top Skills
Airflow
AWS
Databricks
Flink
Hive
Kafka
Python
Spark
SQL
Similar Jobs at Atlassian
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer at Atlassian, you will build and maintain data pipelines, manage a data lake, and optimize data ingestion processes while collaborating with business stakeholders.
Top Skills:
AirflowAWSData Build ToolDatabricksEmrHiveJavaKinesisPythonRdsS3ScalaSparkSQLSqs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Data Engineer, you'll build data products, improve data ingestion, and design self-serve capabilities while working with various data technologies.
Top Skills:
AirflowAmazon Web ServicesDatabricksEmrJavaKinesisPythonRdsS3ScalaSparkSQLSqs
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Join Atlassian's Data Engineering team to define metrics, acquire data, ensure data quality, and improve product engagement. You'll collaborate with product teams and work on data transformation and visualization.
Top Skills:
Data VisualizationETLPythonSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
