Design, build, and maintain scalable data pipelines and integrations across AWS, Azure, and BigQuery. Normalize, aggregate, and secure large web and transactional datasets, leveraging APIs, ETL and orchestration frameworks to support analytics and BI. Collaborate with cross-functional teams, optimize cloud data workflows for performance and cost, and ensure data quality for the e-commerce business.
We are seeking a highly skilled Senior Data Engineer to join our team in Chennai. The ideal candidate will have extensive experience in designing and implementing scalable data solutions, working with large datasets, and building robust data pipelines and leveraging APIs. This role requires strong expertise in cloud platforms and a deep understanding of data engineering best practices within the e-commerce industry.
Responsibilities- Design, develop, and maintain data pipelines to process and transform large volumes of data efficiently.
- Normalize and aggregate data across multiple cloud platforms, including AWS, Azure, and Google BigQuery.
- Leverages APIs for data access and integration with internal and external systems.
- Work with web and transactional data to support analytics and business intelligence initiatives.
- Ensure data quality, integrity, and security across all stages of the data lifecycle.
- Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.
- Optimize data workflows for performance and cost efficiency in cloud environments.
Education/Experience:
- Bachelor’s degree in Computer Science, Engineering, or related field from a reputed institute in India.
- Minimum of 8+ years of experience working in a large-scale organization
- Proven experience with AWS, Azure, and BigQuery for data storage and processing.
- Strong proficiency in SQL, Python, and data transformation tools is a must.
- Hands-on experience in building ETL pipelines, data orchestration frameworks, and RESTful APIs.
- Experience handling large-scale datasets and optimizing data workflows.
- Familiarity with e-commerce industry data, including web analytics and transactional data.
- Knowledge of data modeling, normalization, and aggregation techniques.
- Ability to work independently and as part of a team
Preferred Skills:
- Experience with distributed systems and big data technologies (e.g., Spark, Redshift, Hadoop).
- Solid understanding of data governance, security, and compliance in cloud environments.
- Exposure to real-time data processing and streaming platforms (e.g., Kafka).
Ability:
Demonstrated self-motivation, strong initiative and commitment to continuous improvement.
Willing to help educate other departments and team members about digital analytics and how they can apply actionable results from the data.
Travel:
- None
Disclaimer: The above statements are intended to describe the general nature and level of work being performed. They are not intended to be construed as an exhaustive list of all responsibilities, duties and skills required of personnel so classified. Liquidity Services Inc. reserves the right to modify position duties at any time due to business necessity.
Liquidity Services is an Equal Opportunity Employer.
About UsLiquidity Services (NASDAQ: LQDT) operates the world’s largest B2B e-commerce marketplace platform for surplus assets, with over $15 billion in completed transactions to more than 6 million qualified buyers worldwide and 15,000 corporate and government sellers. It supports its clients’ sustainability efforts by helping them extend the life of assets, prevent unnecessary waste and carbon emissions, and reduce the number of products headed to landfills.Similar Jobs
Digital Media • Information Technology • News + Entertainment
Design, build, and optimize scalable data pipelines and ingestion frameworks across cloud platforms. Write advanced SQL and Python transformations, ensure data quality, lineage, and governance, and implement solutions on Snowflake/Databricks. Collaborate with stakeholders, support downstream consumers, mentor junior engineers, and improve internal tooling, automation, and CI/CD deployment processes.
Top Skills:
AirflowSparkAWSAws S3AzureCi/CdDatabricksDbtGCPIcebergPythonSnowflakeSQL
Digital Media • Information Technology • News + Entertainment
Design, build, and maintain advanced data structures and pipelines for SAP HANA SPM. Implement inbound/outbound integrations with CRM/ERP and data warehouses, ensure data quality, reconciliation, governance, and auditability. Troubleshoot production issues, support UAT and post-deployment validation, document business rules and flows, and provide technical leadership and mentoring.
Top Skills:
CRMData WarehousesErpSalesforceSap Hana SpmSnowflakeTeradata
Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Design and implement scalable data engineering solutions and EDW data models. Build ETL/ELT pipelines (IICS) into Snowflake, optimize performance, enforce governance, support production deployments, conduct code reviews, troubleshoot issues, and collaborate with cross-functional teams to deliver robust, maintainable data platforms.
Top Skills:
AWSAzureEtl/EltInformatica Intelligent Cloud Service (Iics)JavaPythonSnowflakeSQL
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
