Tests AWS Glue data pipelines and file-processing interfaces across functional, integration, reconciliation, regression, performance, resiliency, security, and production scenarios. Defines and validates data quality rules for completeness, accuracy, consistency, validity, uniqueness, timeliness, referential integrity, business rules, and schema consistency. Reviews AWS configurations, parameters, logs, metrics, execution history, authentication, connectivity, retries, timeouts, and delivery validation across S3, SFTP/FTPS, AWS Transfer Family, APIs, and partner endpoints.
The candidate should be able to define and validate data quality rules covering:
- Completeness
- Accuracy
- Consistency
- Validity
- Uniqueness
- Timeliness
- Referential integrity
- Conformity to business rules
- Schema and metadata consistency
Testing Areas
The role will include the following types of testing:
- Functional testing
- End-to-end integration testing
- Data validation testing
- Source-to-target reconciliation
- Parallel Testing with legacy interfaces testing.
- Regression testing
- System integration testing
- User acceptance testing support
- Negative testing
- Exception and error-path testing
- Performance and volume testing
- Scalability testing
- Restart and recovery testing
- Failover and resiliency testing
- Security and access testing
- Production smoke testing
- Operational and monitoring validation
Requirements
- AWS Glue Jobs
- AWS Glue Workflows
- Amazon S3
- Amazon CloudWatch
- AWS IAM
- Amazon EventBridge
- AWS Lambda
- Amazon SNS
- Amazon SQS
- AWS Secrets Manager
- AWS Step Functions
- AWS KMS
- Ability to review AWS Console configurations, job parameters, logs, metrics, and execution history.
- Data Pipeline and File Processing Interface Testing
- Strong understanding of Inbound and Outbound Data File Processing / Data Pipeline.
- Experience testing inbound/outbound file transfers across S3, SFTP/FTPS, AWS Transfer Family, APIs, and external partner endpoints, including authentication, connectivity, retry, timeout, and delivery validation.
Similar Jobs
Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Manage end-to-end fund accounting for Luxembourg real estate fund structures, including NAV calculations, capital accounts, management fees, and real estate transaction recording. Support month/quarter/year-end closes, investor reporting, capital calls, distributions, audits, and regulatory reporting (AIFMD/CSSF). Coordinate with AML/KYC, transfer agency, legal, administrators, auditors, and valuers. Drive process improvements and support system automation.
Top Skills:
Accounting SystemsExcel
Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Develop, design, code, test, and implement Java backend systems using Java, J2EE, Spring, Hibernate, Oracle, Jenkins, Maven, and JUnit. Conduct impact analysis, code reviews, unit testing, technical documentation, estimation, planning, and status reporting. Collaborate with developers and testers, support technical queries, maintain application quality, participate in technical interviews, and mentor junior team members.
Top Skills:
BitbucketDevOpsHibernateJ2EeJavaJava 8JenkinsJIRAJunitMavenOracle SqlPl/SqlSpring
Digital Media • Information Technology • News + Entertainment
Designs, develops, integrates, customizes, and updates software applications aligned with business needs. Analyzes system requirements, troubleshoots complex technical issues, supports software releases, and collaborates with Quality Assurance to ensure reliable applications. Mentors junior engineers, provides technical leadership on routine projects, conducts market and industry research, and trains operational staff on internally developed applications. Requires independent judgment and flexibility to work variable schedules, including nights and weekends.
What you need to know about the Chennai Tech Scene
To locals, it's no secret that South India is leading the charge in big data infrastructure. While the environmental impact of data centers has long been a concern, emerging hubs like Chennai are favored by companies seeking ready access to renewable energy resources, which provide more sustainable and cost-effective solutions. As a result, Chennai, along with neighboring Bengaluru and Hyderabad, is poised for significant growth, with a projected 65 percent increase in data center capacity over the next decade.
