Synechron Logo

Synechron

Sr. PySpark Developer Data Engineer

Posted 3 Hours Ago
Be an Early Applicant
In-Office
Tharamani, Chennai, Tamil Nadu, IND
Senior level
In-Office
Tharamani, Chennai, Tamil Nadu, IND
Senior level
We are seeking a Senior PySpark Developer Data Engineer with extensive experience in data pipeline development, machine learning, and programming in Python and Spark. The candidate will lead data-driven projects, ensuring robust and clean code delivery, working collaboratively with teams and stakeholders.
The summary above was generated by AI

Education

  • Degree in computer science, engineering, mathematics, or equivalent experience 

Experiences:

  • 7+ years of previous commercial experience as a leader in a data-driven role
  • 7+ years of hands-on experience building data pipelines in production and ability to work across structured, semi-structured and unstructured data
  • 7+ years of experience in ML pipeline for streaming/batch workflow

Knowledge & Skills

  • Ability to write clean, maintainable, and robust code in Python
  • Understanding and expertise of software engineering concepts and best practices
  • Knowledge of testing frameworks and libraries
  • Experience with analytics (descriptive, predictive, EDA), feature engineer, algorithms, anomaly detection, data quality assessment and python visualization libraries - e.g. matplotlib, seaborn or other
  • Comfortable with notebook and source code development - Jupyter, Pycharm/VScode
  • Hands-on experience of technologies like Python, Spark/Pyspark, Hadoop/MapReduce/HIVE, Pandas etc.
  • Familiarity with query languages and database technologies, CI/CD, testing and validation of data and software
  • Tech stack and activities that you would use and preform on a daily basis
    • Python
    • Spark (PySpark)
    • Jupyter
    • SQL and No-SQL DBMS
    • Git (as source code versioning and CI/CD)
    • Exploratory Data Analysis (EDA)
    • Imputation Techniques
    • Data Linking / Cleansing
    • Feature Engineering
    • Apache Airflow/ Jenkins scheduling and automation, Github and Github Actions
  • Collaborative - able to build strong relations that enable robust debate and resolve periodic disagreements regarding priorities.
  • Excellent interpersonal, and communication skills
  • Ability to communicate effectively with technical and non-technical audience
  • Ability to work under pressure with a solid sense for setting priorities
  • Ability to lead technical work with strong sense of ownership
  • Strong command of English language (both verbal and written)

Behavioral Competencies

  • Thinking Related
  • People Related
  • Self-Related
  • Practical and action oriented
  • Compelling communicator
  • Excellent stakeholder management
  • Foster and promote entrepreneurial spirit and curiosity amongst team members
  • Team player
  • Quick learner

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Top Skills

Apache Airflow
Git
Hadoop
Hive
Jenkins
Jupyter
Mapreduce
No-Sql
Pandas
Pyspark
Python
SQL

Similar Jobs

An Hour Ago
In-Office or Remote
IN
Senior level
Senior level
Insurance
Design and develop scalable data pipelines using PySpark and Databricks, focusing on data ingestion, transformation, validation, and performance optimization.
Top Skills: DatabricksPysparkPythonSparkSQL
3 Hours Ago
Remote or Hybrid
Chennai, Tamil Nadu, IND
Junior
Junior
Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
The Data Governance Business Analyst will support data governance initiatives, ensuring business processes are captured accurately and translated into solutions by investigating data lineage across systems and collaborating with stakeholders.
Top Skills: Power BITableau
3 Hours Ago
Remote or Hybrid
India
Senior level
Senior level
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
The Lead AI Engineer designs and delivers AI/ML and Generative AI solutions for banking platforms, integrating data and enabling AI-driven decisions.
Top Skills: AWSBedrockLambdaLangchainOpenaiPythonPyTorchS3SagemakerScikit-LearnTensorFlow

What you need to know about the Chennai Tech Scene

To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account