This job focuses on fostering a passionate and customer-centric work culture while supporting employee engagement and growth.
It's fun to work in a company where people truly BELIEVE in what they are doing!
We're committed to bringing passion and customer focus to the business.
Responsibilities
- Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks leveraging open source tools and data processing frameworks.
- Hands-on on technologies such as Kafka, Apache Spark (SQL, Scala, Java), Python, Hadoop Platform, Hive, Presto, Druid, airflow
- Deep understanding of BigQuery architecture, best practices, and performance optimization.
- Proficiency in LookML for building data models and metrics.
- Experience with DataProc for running Hadoop/ Spark jobs on GCP.
- Knowledge of configuring and optimizing DataProc clusters.
- Offer system support as part of a support rotation with other team members.
- Operationalize open source data-analytic tools for enterprise use.
- Ensure data governance policies are followed by implementing or validating data lineage, quality checks, and data classification.
- Understand and follow the company development lifecycle to develop, deploy and deliver the solutions.
Minimum Qualifications:
• Bachelor's degree in Computer Science, CIS, or related field
• Experience on project(s) involving the implementation of software development life cycles (SDLC) GCP DATA ENGINEER
Required Skills & Qualifications:
- Education: Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field.
- 7+ years of experience in data engineering, cloud data solutions, and pipeline development.
- GCP Expertise: Hands-on experience with BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Composer (Airflow), Vertex AI, and IAM Policies.
- Programming: Proficiency in Python, SQL, and Apache Beam (Java or Scala is a plus).
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!
Fractal Chennai, Tamil Nadu, IND Office
Chennai, Tamil Nadu, India, 600034
Similar Jobs
Artificial Intelligence • Consulting
The role involves designing and delivering data solutions on GCP, developing data pipelines and transformations, and managing large-scale client projects.
Top Skills:
SparkBigQueryCloud ComposerCloud SqlDataflowDatastageGcloud CliGcp Data TransferGoogle Cloud PlatformGoogle Cloud Python SdkGoogle Cloud StorageInformaticaKafkaNoSQLPentahoPubsubPythonSQLTalend
AdTech • Beauty • Marketing Tech • Retail • Pharmaceutical
As a Senior Data Engineer, you'll develop cloud-based data platforms, implement ETL processes, create data pipelines, and ensure data quality and governance while collaborating with product managers for business value delivery.
Top Skills:
Big QueryCloud ComposerETLGitGoogle Cloud PlatformLooker StudioPysparkPythonSQLTerraform
Fintech • Financial Services
This role involves developing and designing REST services, enhancing service architecture, migrating functionalities to GCP, and providing support for applications.
Top Skills:
Ci/CdGCPGithub ActionsJavaJfrog ArtifactoryKubernetesMavenOpenapiRestSpringSpring BootSQLTerraform
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
