Build and automate data validation and reconciliation tests for ETL pipelines and data warehouses. Write and optimize complex SQL, investigate data discrepancies, design ETL test strategies, and implement automated testing frameworks to ensure data integrity.
We are seeking a highly skilled and detail-oriented Software Development Engineer in Test (SDET) to join our team with a focus on data reconciliation, complex SQL, and ETL testing. The ideal candidate will have a unique blend of skills in software development, quality assurance, and data engineering. You will be responsible for ensuring data accuracy, validating ETL processes, and building automation frameworks for data-related testing processes. This is a key role to ensure the integrity and quality of our data infrastructure and analytics platforms.
Key Responsibilities:
- Complex SQL Queries:
- Write and optimize complex SQL queries to validate data pipelines, transformations, and reporting accuracy.
- Perform root cause analysis of data discrepancies and provide insights into data quality issues.
- Develop automated SQL scripts to streamline data validation and reconciliation processes.
- ETL Testing:
- Validate ETL processes by designing comprehensive test strategies to ensure data accuracy and completeness.
- Test and verify ETL pipelines from various data sources (structured and unstructured) into data warehouses, ensuring data conforms to business rules and logic.
- Implement automated ETL testing frameworks and continuously improve them to optimize the data validation process.
- Data Reconciliation:
- Develop, implement, and automate test scripts to validate data integrity between source and target systems.
- Identify and resolve data inconsistencies, mismatches, and errors in large datasets.
- Design and execute reconciliation processes to ensure accurate data migration and transformation.
Nice to have:
- Experience with HiveQL for Hive Database
- Experience with Python as a scripting language
Photon Chennai, Tamil Nadu, IND Office
DLF IT Park 1/124 Mount Poonamallee Road Sivaji Gardens Manapakkam , Chennai, India, 600089
Similar Jobs
Agency • Information Technology
Designs, builds, and maintains scalable automated test frameworks across UI, API, integration, and performance. Writes production-quality test code, integrates tests into CI/CD, drives shift-left testing, measures quality metrics, leads root cause analysis, manages test data/environments, mentors SDETs, and collaborates with Architecture, Security, and SRE to cover non-functional requirements.
Top Skills:
Ci/CdCypressGithub ActionsGitlab CiJavaJavaScriptJenkinsPlaywrightPythonRest AssuredSeleniumTypescript
Cloud • Information Technology • Security • Software • Cybersecurity
Leads Zscaler’s Professional Services sales organization in India, owning bookings quotas, service attach rates, go-to-market strategy, forecasting, and enterprise deal execution. Recruits and develops field Service Sales Managers, partners with enterprise sales and customer success leaders, sponsors complex engagements, and guides multi-phase Statements of Work. The role requires executive-level selling, strategic knowledge of SSE/SASE, SaaS, IaaS, and Zero Trust, plus experience scaling quota-carrying teams in global technology organizations.
Top Skills:
Ai ToolsCloud SecurityIaasSaaSSaseSseZero Trust Security
Cloud • Information Technology • Security • Software • Cybersecurity
Monitor security alerts, detect and analyze threats, respond to security incidents, assess their scope and impact, and investigate phishing incidents. The role requires experience with SOC operations, SIEM, EDR, IDS/IPS, firewalls, antivirus tools, networks, operating systems, and endpoint fundamentals. Preferred qualifications include AI-assisted threat detection, security scripting, and certifications such as Security+, CISSP, or CISM.
Top Skills:
Ai/MlAntivirusCC#ChronicleComputer NetworksCrowdstrike FalconEdrEndpoint SecurityFirewallsIds/IpsOperating SystemsPowershellPythonSIEM
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
