Test Engineer

Job Description

Focus: Autonomous Testing Validation

Department: Technology

Location: United States – Remote

Experience Level: Mid-Level

Security Requirement: Must be eligible to obtain and maintain the required Public Trust determination and DoD system access

About the Role

We are seeking a Mid-Level Test Engineer to support the validation and oversight of autonomous and AI-powered software testing within a federal/DoD technology environment. The primary responsibility of this role is to serve as a human-in-the-loop validation layer for autonomous testing. The Test Engineer will review AI-generated tests, evaluate autonomous test execution results, validate reported defects and risks, identify gaps or false positives, and ensure testing evidence is sufficiently accurate and reliable to support engineering and release decisions. The role requires strong software testing judgment, attention to security and data-handling requirements, and the ability to work within controlled government technology environments.

What You'll Do

• Review and validate test cases and scenarios generated by autonomous testing agents.
• Analyze autonomous test execution results and determine whether identified failures and risks are valid.
• Identify false positives, false negatives, duplicate findings, and gaps in autonomous test coverage.
• Validate that autonomous agents correctly interpret requirements, application functionality, workflows, and expected behavior.
• Perform targeted manual and exploratory testing to confirm autonomous testing results.
• Review supporting evidence including screenshots, execution logs, network activity, API responses, and system behavior.
• Validate critical user journeys, integrations, edge cases, and business rules.
• Reproduce and document confirmed defects for remediation by application development teams.
• Retest resolved defects and verify that fixes have not introduced regression issues.
• Maintain traceability between requirements, autonomous tests, validation results, defects, and supporting evidence.
• Work with developers, product teams, security personnel, and government stakeholders to clarify expected system behavior.
• Follow applicable security, access-control, data-handling, and system-use requirements when working within government environments.
• Protect government, sensitive, proprietary, and Controlled Unclassified Information (CUI), when applicable, in accordance with organizational and contractual requirements.
• Complete required security and cybersecurity awareness training and maintain compliance throughout the period of performance.

What We're Looking For

• 3–5 years of professional software testing or quality engineering experience.
• Strong experience with functional, regression, integration, API, and exploratory testing.
• Experience analyzing test failures and distinguishing application defects from test, data, configuration, or environment issues.
• Strong understanding of software testing principles and test design techniques.
• Experience interpreting requirements, acceptance criteria, user stories, and technical documentation.
• Working knowledge of test automation concepts and automated test execution.
• Experience testing web applications and APIs.
• Ability to investigate application behavior using developer tools, logs, network requests, API responses, and other technical evidence.
• Strong analytical and critical-thinking skills.
• Strong defect documentation and written communication skills.
• Ability to work independently within a remote and security-conscious engineering environment.

Nice to Have (not required)

• Experience supporting U.S. federal government or Department of Defense software programs.
• Experience with AI-powered, agentic, or autonomous testing platforms.
• Experience validating AI-generated test cases or AI-generated technical output.
• Experience with Playwright, Cypress, Selenium, WebdriverIO, or similar automation frameworks.
• Experience with API testing tools.
• Experience with Jira or comparable test and defect management systems.
• Familiarity with CI/CD environments.
• Familiarity with Section 508/accessibility testing.
• Familiarity with government cybersecurity, CUI, and system-access requirements.

What We Offer

Competitive salary commensurate with competence and experience. Referral bonus in accordance with existing referral programme. A collaborative team environment supported by AI.

Security & Eligibility Requirements

This position supports systems and environments that may require U.S. Government access authorization. Candidates must:

• Be based in the United States.
• Be legally authorized to work in the United States.
• Be able to successfully complete the background investigation and adjudication required for the position.
• Be eligible to obtain and maintain the required Public Trust determination for the assigned government program.
• Be eligible to obtain and maintain access to applicable DoD/government information systems, including completion and approval of DD Form 2875 – System Authorization Access Request (SAAR) when required.
• Complete required cybersecurity, information assurance, privacy, and security-awareness training.
• Comply with applicable government and organizational rules governing system access, credentials, sensitive information, and acceptable use.
• Maintain continued eligibility for government system access throughout employment when required by the assigned program.

Existing Public Trust eligibility or prior experience working in a DoD/federal environment is preferred but is not required unless specified by the applicable contract.

What Success Looks Like

Success in this role means autonomous testing produces results that engineering and government stakeholders can trust. The Test Engineer provides the human judgment necessary to determine whether autonomous agents tested the right functionality, interpreted requirements correctly, identified legitimate risks, and generated sufficient evidence to support technical and release decisions. The engineer also maintains the security, traceability, and accountability expected when performing testing within a government technology environment.