The Big Data Lead will maintain SQL databases, build data pipelines and streams using Databricks, Pyspark, and SQL, and design APIs.
Request ID: 36357JD/Skillset: Data EngineerExperience: 5+ yearsResponsibilities:Maintain SQL databases, build data pipelines and data streams using Databricks, Pyspark and SQL Database environment.Involve in design and build data service APIsMandatory Skill SetSQL server, Databricks, Spark, ETL, Azure Data Factory
Hexaware Technologies Chennai, Tamil Nadu, IND Office
MCN Nagar Ext, MCN Nagar Extension, Thoraipakkam, Chennai, Tamil Nadu, India, 600097
Similar Jobs
Information Technology • Consulting
Lead design and optimization of cloud data warehouses on Snowflake, build scalable ETL/ELT pipelines, leverage Snowflake advanced features and ML tooling, and use cloud-native AWS services and modern ETL tools to operationalize data solutions.
Top Skills:
AWSCortex AiData SharingDbtHorizon CatalogIics (Informatica Intelligent Cloud Services)Informatica CloudLambdaMatillionMlopsS3SnowflakeSnowpark MlSnowpipeSnsSqsStagesStreamlit
Information Technology • Consulting
Design, build, and maintain scalable data solutions and pipelines in Azure or Microsoft Fabric for financial market data. Implement Medallion architecture with delta tables, SCD Type 2, data quality frameworks, vendor ingestion (Bloomberg, MSCI, LSEG, ICE), entitlement management, and BCDR strategies. Collaborate with stakeholders and produce reporting/Power BI deliverables.
Top Skills:
AdlsAzureAzure Cosmos DbAzure DatabricksAzure Etl ToolsAzure SqlAzure Synapse AnalyticsBloombergDelta TablesDq StudioFabric Sql DatabaseFabric WarehouseIceLsegMicrosoft FabricMicrosoft Fabric LakehouseMsciPower BIPysparkPythonSqlpackageT-Sql
Information Technology • Consulting
Lead development of big data solutions, focusing on text data processing, data pipelines, and cloud services, primarily in AWS and GCP.
Top Skills:
AWSDockerElasticsearchGCPHadoopHbaseKubernetesMongoDBPythonSpark
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
