Develop and optimize data engineering pipelines using Python, Databricks, Spark, PySpark, SQL, and AWS services. Build ETL/ELT workflows, transform and integrate data, troubleshoot pipeline issues, and apply data warehousing concepts. The role also involves working with Delta Lake, pipeline orchestration, Git, and CI/CD practices while collaborating effectively and solving complex data problems.
This is a remote position.
Job Title: Databricks / AWS / Python Developer
Experience: 5–6 Years
Job Description:
- Strong hands-on experience in Python programming and data engineering.
- Good exposure to Databricks, including notebooks, Spark, and data processing.
- Experience with AWS services such as S3, Glue, Lambda, and Redshift.
- Knowledge of PySpark, SQL, ETL/ELT pipelines, and data transformation.
- Experience in developing, optimizing, and troubleshooting data pipelines.
- Understanding of data warehousing concepts and data integration.
- Good analytical, problem-solving, and communication skills.
Preferred Skills:
- Experience with Databricks on AWS.
- Knowledge of Delta Lake and data pipeline orchestration.
Exposure to Git and CI/CD practices.
SRM Technologies Chennai, Tamil Nadu, IND Office
Chennai, India
SRM Technologies Chennai, Tamil Nadu, IND Office
Perungudi, Campus 1A, 5th Floor, RMZ Millenia Business Park, , , , Chennai, Tamil Nadu, India, 600096
Similar Jobs
Database
Build and maintain Supabase’s public Python SDK across database, authentication, storage, realtime, and edge functions. Develop natural sync and async APIs, manage typing, packaging, testing, release automation, documentation, and issue triage. Collaborate with cross-functional teams and open-source contributors, support multiple Python environments, maintain WebSocket functionality, and design migration paths for API changes. Work autonomously in a remote, asynchronous environment while making the SDK accessible to developers and AI coding agents.
Top Skills:
AsyncioCi/CdJwtOauthPostgresPyproject.TomlPythonPython TypingTypeddictWebsocketsWheels
Information Technology • Professional Services • Software • Consulting
Develop Python applications and backend services powered by Agentic AI, autonomous agents, multi-agent workflows, and LLMs. Responsibilities include building tool- and function-calling workflows, REST APIs, RAG solutions, external integrations, and production-ready AI applications. The role also supports testing, deployment, optimization, and collaboration with engineering teams. Preferred experience includes AI frameworks, cloud platforms, containerization, vector databases, prompt engineering, and LLM evaluation.
Top Skills:
Agentic AiAnthropic ClaudeAutogenAutonomous AgentsAws BedrockAzure OpenaiCrewaiDockerEmbeddingsFastapiFlaskGenerative AiGoogle Vertex AiKubernetesLangchainLanggraphLarge Language Models (Llms)Multi-Agent SystemsOpenaiPythonRagRest ApisSemantic SearchVector Databases
Artificial Intelligence • Food • Software
Build, operate, and scale enterprise web applications using Python and React.js. Develop REST and GraphQL APIs, asynchronous processing, responsive interfaces, database queries, automated tests, and CI/CD workflows. Own features end to end, improve architecture and observability, modernize legacy systems, resolve outages, reduce technical debt, and mentor engineers. Collaborate with Product and Design in a remote, pod-based organization while leveraging AI coding agents.
Top Skills:
AWSCi/CdClaude CodeCodexDatadogDockerGithub ActionsGraphQLJavaScriptMySQLNew RelicPostgresPythonReactRestSentrySidekiqSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
