Test Automation Engineer
Position Overview
The Test Engineer will support a large-scale government agency initiative to modernize a complex, interdependent data intensive system of systems transitioning from legacy on-premise platforms to AWS cloud-native architectures.
This is not a traditional QA role. It is a cloud-native test automation engineering position responsible for ensuring functional equivalence, data integrity, and automated regression validation during migration from legacy technologies (e.g., SAS-based and file-driven systems) to modern Python-based serverless and microservices AWS Cloud Native applications.
The Test Engineer will work as part of an Agile Scrum Team and collaborate with other Test Engineers in parallel workstreams to ensure the system of systems is validated end-to-end. This includes coordinated regression testing, integration validation, and synchronized release readiness across interconnected platforms.
Key Responsibilities
Legacy-to-Cloud Validation (Functional & Data Integrity)
- Design and execute parallel validation frameworks comparing legacy system outputs to modernized AWS Cloud Native outputs.
- Develop automated regression test suites using Python, Selenium and other automation frameworks.
- Validate:
- Business logic equivalence
- Data transformation accuracy
- Aggregation and computational correctness
- End-to-end workflow outputs
- Validate high-volume, data-intensive application behavior under realistic production load conditions.
- Collaborate with SMEs to define statistical and functional acceptance criteria.
Agile Scrum Team Participation
- Participate in Sprint Planning, Daily Standups, Reviews, and Retrospectives.
- Embed automated testing into the Definition of Done.
- Partner closely with developers to shift-left testing practices and collaborate to establish test driven development.
- Support continuous validation across sprint increments.
Automation Engineering & DevSecOps Integration
- Design and implement automated testing frameworks integrated into CI/CD pipelines (GitLab or equivalent).
- Develop robust test automation using:
- Python (expert-level required)
- Selenium (expert-level required)
- Additional scripting/automation tools as appropriate (e.g., PyTest, Behave, Robot Framework, Bash, PowerShell, etc).
- Implement automated unit, integration, regression, and system-level testing.
- Enable push-button regression validation across interconnected subsystems.
- Integrate automated security and compliance checks into release pipelines.
- Validate AWS Cloud Native workloads including serverless, containerized, and batch processing architectures.
- Develop
System-of-Systems & Cross-Workstream Validation
- Collaborate with Test Engineers across workstreams to validate:
- End-to-end data flow across processing, analytics, and dissemination systems
- API integrations, event-driven triggers, and orchestration mechanisms
- Sequencing and dependency alignment across modernization phases
- Support coordinated integration testing for large-scale system-of-systems deployments.
- Validate automated workflow gating and orchestration logic replacing manual triggers.
UI & Application Testing
- Develop automated UI and workflow testing using Selenium.
- Validate configuration-driven applications and workflow interfaces.
- Test analytical dashboards and reporting platforms (e.g., Amazon QuickSight, QJS, or equivalent BI platforms).
- Validate performance, accessibility, and browser compatibility.
Data Quality & Test Data Engineering
- Develop and maintain:
- Synthetic datasets
- Golden regression datasets
- High-volume scalability datasets
- Automate validation of ingestion pipelines (API-driven, database-driven, batch-based).
- Validate database integrity (Aurora/Postgres or equivalent).
- Support test data staging and masking in AWS environments.
Governance & Documentation Support
- Maintain requirements-to-test-case traceability.
- Produce automated test artifacts supporting architecture review and security authorization processes.
- Participate in structured defect triage and release readiness reviews.
Requirements
Required Qualifications
- 5+ years of experience in automated testing and quality engineering.
- Expert-level proficiency in Python.
- Expert-level proficiency in Selenium and UI automation frameworks.
- Strong expertise in automation scripting languages (e.g., Bash, PowerShell, PyTest, Robot Framework, Behave, or similar).
- Experience testing AWS Cloud Native applications.
- Experience building automated testing frameworks for a legacy on-prem to cloud migration project.
- Experience validating data-intensive applications and distributed systems.
- Experience building CI/CD-integrated automated test frameworks.
- Experience with relational databases (Postgres preferred).
- U.S. Citizenship required.
Preferred Qualifications
- Experience supporting regulated or federal environments.
- Familiarity with legacy SAS-based systems.
- Experience validating BI/analytics platforms (QuickSight, QJS, or similar).
- Experience operating within FedRAMP, NIST, or comparable compliance frameworks.
- Experience validating event-driven and serverless architectures.
- Experience in large-scale system-of-systems modernization programs.
Key Competencies
- Deep automation engineering expertise
- Systems-level thinking across AWS Cloud Native platforms
- Precision in validating data integrity and business logic equivalence
- Strong collaboration across Agile Scrum Teams
- Ability to operate within highly governed and security-conscious environments
Benefits
- 401(k)
- 401(k) matching
- Dental insurance
- Flexible spending account
- Health insurance
- Life insurance
- Paid time off
- Professional development assistance
- Referral program
- Tuition reimbursement
- Vision insurance