Design and build scalable data pipelines and API integrations, write reusable Python code for ingestion and automation, use SQL to derive insights, support streaming and batch ETL across storage systems, maintain and improve engineering infrastructure, collaborate with analysts, data scientists and stakeholders, and perform end-to-end development, QA and DevOps tasks.
Ciklum is looking for a Senior Data Engineer to join our team full-time in India.
We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.
About the role:
As a Senior Data Engineer, become a part of a cross-functional development team engineering experiences of tomorrow.
Responsibilities:
- Build and prototype scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity
- Write reusable, testable, and efficient code in Python for data ingestion and integration tasks
- Use SQL and Python to help find insights in data, collaborating with business stakeholders on specific projects
- Work on multiple projects simultaneously, adapting to changing priorities in a fast-paced environment
- Act as a problem solver, employing a creative approach to tackle complex challenges and drive continuous improvement in data strategy and execution
Requirements:
- Proven experience as a data engineer or in a similar role with a focus on data integration and management
- Strong programming skills in Python, with experience in API interactions and automation
- Solid foundation in SQL and relational database design
- Excellent problem-solving skills and the ability to think algorithmically
- Strong communication skills and the ability to work collaboratively in a team-oriented environment
- Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple data storages
- Contributes to the maintenance of engineering infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed
- Interacts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability
- Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
- Works directly with business analysts and data scientists to understand and support their use-case
- Contribute in the Unit’s activities and community building, participate in conferences, provide excellence in exercise and best practices
- Help in sales activities, customer meetings and digital services
- Understanding of cloud infrastructure design and implementation
Desirable:
- Experience with cloud services (AWS, Google Cloud Platform, etc.)
- Knowledge of data warehousing and ETL techniques.
- Familiarity with version control tools like Git
What`s in it for you?
- Care: your mental and physical health is our priority. We ensure comprehensive company-paid medical insurance, as well as financial and legal consultation
- Tailored education path: boost your skills and knowledge with our regular internal events (meetups, conferences, workshops), Udemy licence, language courses and company-paid certifications
- Growth environment: share your experience and level up your expertise with a community of skilled professionals, locally and globally
- Flexibility: hybrid work mode at Chennai or Pune
- Opportunities: we value our specialists and always find the best options for them. Our Resourcing Team helps change a project if needed to help you grow, excel professionally and fulfil your potential
- Global impact: work on large-scale projects that redefine industries with international and fast-growing clients
- Welcoming environment: feel empowered with a friendly team, open-door policy, informal atmosphere within the company and regular team-building events
About us:
At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.
India is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game-changing solutions and take your career to the next level.
Explore, empower, engineer with Ciklum!
Interested already? We would love to get to know you! Submit your application. We can’t wait to see you at Ciklum.
#LI-RB1
Ciklum Chennai, Tamil Nadu, IND Office
Campus 3B, Co-Wrks, 5th Floor, RMZ Millenia Park II, MGR Main Rd, Kandanchavadi, Perungudi, Chennai, India, 600096
Similar Jobs
Cloud • Information Technology • Consulting • Cybersecurity
Design, build, and maintain scalable ETL/ELT data pipelines and data warehouse solutions using Snowflake. Optimize data models and query performance, ensure data quality, integrate multiple sources, implement security and governance, and collaborate with BI and product teams to deliver reliable datasets.
Top Skills:
AirflowAWSAzureCi/CdDbtDevOpsGCPHadoopInformaticaKafkaKinesisPythonScalaSnowflakeSparkSQL
Cloud • Enterprise Web • HR Tech
Build and maintain scalable ETL/ELT pipelines and data platforms, optimize queries and databases, design analytics-ready data models, ensure data quality and governance, collaborate with stakeholders, and support data products and automation for business intelligence and analytics.
Top Skills:
AthenaAws GlueAws LambdaAzure Data FactoryAzure Data Lake Storage (Adls)Azure Sql DatabaseAzure SynapseCi/CdDatazoneFivetranGitLake FormationMicrosoft FabricPl-SqlPower BIPythonS3SQLSsisT-Sql
Fintech • Payments • Financial Services
Design, build, and maintain scalable data pipelines, ETL processes, and data architectures (lakes, warehouses). Develop real-time streaming apps (Spark Streaming, Flink), optimize Spark performance, ensure data quality, governance, and security, integrate AI/ML pipelines, evaluate new data technologies, troubleshoot pipeline performance, and mentor junior engineers.
Top Skills:
Apache FlinkApache IcebergSparkAws AthenaAws DynamodbAws EmrAws KinesisAws QuicksightCi/CdDockerEtl ToolsFastapiHiveKubernetesParquetPodmanPostgresPythonScalaSpark StreamingSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
