Lead the architecture and development of a Risk and Entity Intelligence Platform. Build scalable data pipelines, ETL and ingestion systems, entity resolution capabilities, graph database solutions, and risk intelligence products. Apply compliance, KYC/AML, sanctions, and multilingual data expertise while making technical decisions and mentoring engineers. The role also involves working with APIs, web scraping, cloud infrastructure, workflow orchestration, and large-scale data acquisition.
We are looking for an experienced Lead Data Engineer to design and build a next-generation Risk & Entity Intelligence Platform. The ideal candidate will lead the development of scalable data pipelines, entity resolution systems, graph databases, and risk intelligence solutions while mentoring a team of engineers. This is a hands-on leadership role involving architecture, development, and technical decision-making.
Requirements
Similar Jobs
eCommerce • Retail • Software
Designs and maintains scalable Snowflake data warehouses and modern data architectures supporting Marketing, Sales, and Customer Service. Develops SQL and dbt transformations, data models, ETL/ELT pipelines, and real-time or batch integrations. Ensures data quality through profiling, validation, cleansing, and performance optimization. Troubleshoots processing issues, participates in code reviews, and collaborates with cross-functional teams to deliver analytics-ready data solutions.
Top Skills:
AWSAzureAzure DatabricksDbtEltETLGCPPythonSnowflakeSQL
Fintech • Analytics
Lead a small data engineering team to onboard, migrate, operate, and optimize pipelines on a Databricks-on-AWS lakehouse. Support ingestion, transformation, governance (Unity Catalog, Glue), Delta/Iceberg table patterns, pipeline monitoring, CI/CD, and cross-team collaboration to ensure secure, reliable, and performant enterprise data workflows.
Top Skills:
Amazon AthenaAmazon CloudwatchAmazon KinesisAmazon S3Apache IcebergAws GlueAws Glue Data CatalogAws IamAws Lake FormationAws LambdaAws Step FunctionsCi/CdDatabricksDelta LakeInfrastructure As CodePysparkPythonSparkSQLUnity Catalog
Automotive • eCommerce • Retail • Sales
Leads a team of data engineers and owns the architecture, implementation, governance, security, and optimization of a GCP Data Lakehouse platform. Responsibilities include designing Spark and Delta Lake pipelines, managing Unity Catalog, improving SQL and ETL performance, enabling analytics and machine learning use cases, implementing CI/CD with GitLab and Jenkins, and communicating technical strategies to stakeholders.
Top Skills:
Apache AirflowApache KafkaSparkConfluenceDelta LakeEmbedding ModelsGCPGcp Cloud StorageGcp Data LakeGcp Pub/SubGitGitlabJenkinsJIRALlmsLooker StudioMlflowPostgresPower BIPysparkPythonRagScalaSQLTerraformUnity CatalogVector Databases
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
