Jobs at ProArch

Tests AWS Glue data pipelines and file-processing interfaces across functional, integration, reconciliation, regression, performance, resiliency, security, and production scenarios. Defines and validates data quality rules for completeness, accuracy, consistency, validity, uniqueness, timeliness, referential integrity, business rules, and schema consistency. Reviews AWS configurations, parameters, logs, metrics, execution history, authentication, connectivity, retries, timeouts, and delivery validation across S3, SFTP/FTPS, AWS Transfer Family, APIs, and partner endpoints.

Designs, develops, and supports scalable AWS-based file ingestion and data processing solutions using Python, AWS Glue, and PySpark. Responsibilities include building ETL workflows, integrating databases and APIs, implementing validation and error handling, configuring serverless AWS services, optimizing performance and cost, supporting production operations, and collaborating on CI/CD. The role also requires monitoring, security configuration, documentation, reconciliation, and audit processes.