Test Automation Analyst

Description

The Test Automation Analyst is responsible for developing automated testing frameworks, creating automated UI and API test suites using Playwright, integrating tests into CI/CD pipelines, and collaborating with product, development, and infrastructure teams throughout the software development lifecycle.

Mission:

The Test Automation Engineer supports the National Registry’s mission to support the EMS profession through partnerships, research, and lifelong assessment of clinical competence by ensuring the quality, reliability, and performance of the technology platforms that deliver certification and assessment services. Through the design and execution of automated testing solutions, this role helps ensure that assessment systems, digital products, and supporting applications function accurately, securely, and consistently for candidates, stakeholders, and staff.

Essential Functions:

• Design, develop, maintain and optimize automated testing frameworks, reusable automation components, and scalable test solutions to improve automation coverage and reduce manual testing efforts.
• Create, execute, and maintain automated UI, API, integration, regression, and end-to-end, and validation test suites for web applications, APIs, and cloud-hosted services using Playwright.
• Execute functional, regression, integration, end-to-end, and user acceptance testing to validate business requirements, acceptance criteria and release readiness.
• Identify, document, prioritize, and track defects through resolution, participating in root cause analysis to improve product quality and system reliability.
• Collaborate with Business Analysts, Product Owners, Developers, DevOps teams, and other stakeholders throughout the Agile development lifecycle, participating in sprint ceremonies and supporting backlog refinement, story grooming, and retrospectives.
• Promote shift-left testing practices by identifying quality risks early and assisting teams in defining measurable acceptance criteria and testability requirements.
• Integrate and maintain automated tests within CI/CD pipelines, supporting automated quality gates, release validation, and analysis of test execution results to provide actionable feedback.
• Collaborate with DevOps and Infrastructure teams to maintain stable testing environments and support continuous delivery processes.
• Perform testing and validation of AWS-hosted, cloud-native, and containerized applications, APIs, microservices, and distributed systems to verify system reliability, resiliency, and operational readiness.

Requirements

Qualifications:

• 3–5+ years of quality assurance and test automation experience required.

• Hands-on experience with Playwright automation frameworks required.

• Strong proficiency in TypeScript or JavaScript required. 

• Experience testing RESTful APIs using Postman or equivalent tools required.

• Experience creating automated UI and API testing solutions required.

• Experience with Git-based source control systems required.

• Experience working with CI/CD tools including GitHub Actions, Jenkins, Azure DevOps, or equivalent platforms required.

Competencies:

• Strong analytical, troubleshooting, communication, and documentation skills.

• Strong test planning and execution & validation skills.

• Ability to effectively work in an Agile environment and SDLC practices. 

• Strong test planning, experience and validation knowledge. 

• Strong ability to understand SQL and relational databases.

Other Requirements:

• Must be able to work in an office environment.