Arcadia.com Logo

Arcadia.com

Data Engineer III

Job Posted 9 Days Ago Posted 9 Days Ago
Be an Early Applicant
In-Office
Chennai, Tamil Nadu
Mid level
In-Office
Chennai, Tamil Nadu
Mid level
Design, develop, and maintain data pipelines in AWS using Snowflake, Fivetran, and dbt. Collaborate with teams for data integrity and to optimize workflows.
The summary above was generated by AI
Who we are

Perch Energy is a leading community solar servicer on a mission to make renewable energy more accessible and equitable for all. Community solar breaks down the traditional barriers preventing most people from participating in the renewable energy economy. We work in numerous states across the US to bring community solar to communities and individuals who can most benefit from a more inclusive energy system. By managing the customer experience for solar farm owners, Perch is able to bring electricity bill savings to the masses, from renters and homeowners to businesses, institutions, municipalities and more by connecting them to community solar projects in their area. Perch isn’t just a for-profit company, we’re a for-purpose company—accelerating the shift to renewables nationwide. Everyone deserves to benefit from clean energy. Everyone has a place on this Perch!

What we’re looking for

As a Data Engineer, you will play a key role in designing, developing, and maintaining our data infrastructure and pipelines. You will collaborate closely with the rest of our Data and Analytics Engineering team and with engineering and operations teams to ensure the smooth flow and availability of high-quality data for analysis and reporting purposes. Your expertise will be essential in optimizing data workflows, ensuring data integrity, and scaling our data infrastructure to support our company's growth.  

This is an exceptional opportunity for someone who relishes the chance to engage with cutting-edge technology, influence the development of a world-class data ecosystem and work in a fast-paced environment on a small, high-impact team. 

Our core data stack makes heavy use of Snowflake and dbt Core, orchestrated in Prefect and Argo in our broader AWS-based ecosystem. Most of our wide range of data sources are loaded with Fivetran or Segment, but we use custom Python when it’s the right tool for the job. 

What you’ll do
  • Design, develop, and maintain scalable and efficient data pipelines in an AWS environment, centered on our Snowflake instance and using Fivetran, Prefect, Argo, and dbt.
  • Collaborate with business analysts, analytics engineers, and software engineers to understand data requirements and deliver reliable solutions.
  • Design, build and maintain tooling that enables users and services to interact with our data platform, including CI/CD pipelines for our data lakehouse, unit/integration/validation testing frameworks for our data pipelines, and command-line tools for ad-hoc data evaluation.
  • Identify and implement best practices for data ingestion, transformation, and storage to ensure data integrity and accuracy.
  • Optimize and tune data pipelines for improved performance, scalability, and reliability.
  • Monitor data pipelines and proactively address any issues or bottlenecks to ensure uninterrupted data flow.
  • Develop and maintain documentation for data pipelines, ensuring knowledge sharing and smooth onboarding of new team members.
  • Implement data governance and security measures to ensure compliance with industry standards and regulations.
  • Keep up to date with emerging technologies and trends in data engineering and recommend their adoption as appropriate.
What will help you succeedMust-haves
  • 3+ years as a Data Engineer, data-adjacent Software Engineer, or a did-everything small data team member with a focus on building and maintaining data pipelines.
  • Strong Python skills, especially in the context of data orchestration.
  • Strong understanding of database management and design, including experience with Snowflake or an equivalent platform.
  • Proficiency in SQL
  • Familiarity with data integration patterns, ETL/ELT processes, and data warehousing concepts.
  • Experience with Argo, Prefect, Airflow, or similar data orchestration tools.
  • Excellent problem-solving and analytical skills with a strong attention to detail.
  • Ability to bring a customer-oriented and empathetic approach to understanding how data is used to drive the business.
  • Strong communication skills.
Nice-to-haves
  • Undergraduate and/or graduate degree in math, statistics, engineering, computer science, or related technical field
  • Experience with our stack: AWS, Snowflake, Fivetran, Argo, Prefect, dbt, and Github Actions, along with some ancillary tools
  • Experience with DevOps practices, especially CI/CD
  • Previous experience managing enterprise-level data pipelines and working with large datasets
  • Experience in the energy sector

Benefits:

  • Competitive compensation based on market standards.
  • We are working on a hybrid model with remote first policy
  • Apart from Fixed Base Salary potential candidates are eligible for following benefits
    • Flexible Leave Policy
    • Office is in the heart of the city in case you need to step in for any purpose.
    • Medical Insurance (1+5 Family Members)
    • We provide comprehensive coverage including accident policy and life Insurance. 
    • Annual performance cycle
    • Quarterly team engagement activities and rewards & recognitions
    • L&D programs to foster professional growth
    • A supportive engineering culture that values diversity, empathy, teamwork, trust, and efficiency

Eliminating carbon footprints, eliminating carbon copies.

Here at Perch, we cultivate diversity, celebrate individuality, and believe unique perspectives are key to our collective success in creating a clean energy future. Perch is committed to equal employment opportunities regardless of race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, protected veteran status, or any status protected by applicable federal, state, or local law. While we are currently unable to consider candidates who will require visa sponsorship, we welcome applications from all qualified candidates eligible to work in India.

We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request

Thank you

Top Skills

Argo
AWS
Dbt
Fivetran
Github Actions
Prefect
Python
Snowflake
SQL

Similar Jobs

2 Hours Ago
Hybrid
Chennai, Tamil Nadu, IND
Mid level
Mid level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
As a Big Data Engineer, you will create ETL data pipelines, develop data models, optimize data storage, and provide technical support.
Top Skills: AthenaAWSDbtEmrETLGlueMulesoftPythonRedshiftS3SnowflakeSparkSQLTalend
10 Hours Ago
Hybrid
Chennai, Tamil Nadu, IND
Senior level
Senior level
Automotive • Hardware • Robotics • Software • Transportation • Manufacturing
The Assistant Manager in Engineering is responsible for product design and engineering techniques while managing stakeholders and ensuring program deliverables.
Top Skills: CatiaComputer Aided DesignUg
Yesterday
Hybrid
Chennai, Tamil Nadu, IND
Mid level
Mid level
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Tableau Developer will create interactive dashboards and data visualizations, develop data models, and collaborate with teams to optimize performance and reporting specifications.
Top Skills: Aws RedshiftSQLTableau DesktopTableau PrepTableau Server

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account