All roles

Open role

AI Test Lead (W2 only)

Remote · Sri Lanka Full-time

Job Title: AI Test Lead Location: 100% Remote Long term contract NOTES: Project Overview: TechEvo Application Modernization

Job Description

  • Hands-on quality engineering lead or Senior AI Tester responsible for reverse-engineering application behavior, establishing missing system integration regression coverage, designing AI assisted test generation workflows and proving that agent driven modernization preserves functional, integration, security and operational behavior.

Required Skills - 7-10 Years of QA/SDET/QE experience with strong automation and AI testing skills.

  • Good experience with AI Assisted QE, system integration testing.
  • Strong SDET/quality engineering background with hands on automation of APIs, integrations, UI and end to end enterprise workflows.
  • Demonstrated use of AI/agentic tools to generate, refine, review, or maintain test scenarios and automation not merely general chatbot usage.
  • Experience creating regression, system integration coverage for applications with incomplete or outdated test suites.
  • Strong knowledge of test strategy, risk-based testing, test design, traceability, defect management, root-cause analysis and CI/CD quality gates.
  • Hands on experience with modern automation tools such as Playwright, Cypress, Selenium, REST/API automation, or equivalent; ability to choose tools based on architecture.
  • Working knowledge of Java/.NET application behavior, databases/SQL, APIs, middleware,
  • authentication/authorization, and enterprise integration patterns.
  • Understanding of LDAP and token-based authentication concepts sufficient to design security and role/authorization test scenarios.
  • Ability to evaluate nondeterministic AI outputs with repeatable acceptance criteria, structured evaluation, and human verification.

Job Requirements -

  • 7-10 Years of QA/SDET/QE experience with strong automation and AI testing skills.
  • Good experience with AI Assisted QE, system integration testing.

Role Purpose: Hands-on quality engineering lead or Senior AI Tester responsible for reverse-engineering application behavior, establishing missing system integration regression coverage, designing AI assisted test generation workflows and proving that agent driven modernization preserves functional, integration, security and operational behavior. Roles and Responsibilities:

  • 7-10 Years of QA/SDET/QE experience with strong automation and AI testing skills.
  • Good experience with AI Assisted QE, system integration testing.
  • Assess each application's existing test assets, business-critical flows, integrations, data dependencies, security behavior and regression risk before modernization begins.
  • Reverse-engineer system behavior with developers and AI agents, then create a risk-based system integration and regression strategy where adequate suites do not already exist.
  • Design and build executable test suites in enterprise test management/automation tooling (for example Xray-style suites), beyond developer-only unit/JUnit coverage.
  • Create, refine and govern AI agents/skills that assist with test scenario generation, test data design, coverage analysis, traceability, defect triage and regression maintenance.
  • Define test coverage for runtime/framework upgrades, dependency changes, OS/middleware changes, database/integration impacts, and LDAP-to-Okta/token-based security changes.
  • Establish quality gates for agent-generated code and modernization changes, including functional, integration, API, security, negative, compatibility, performance-smoke and deployment validation as appropriate.
  • Lead testers embedded in delivery pods, assign test work, review automation, coach AI-assisted testing practices and remain hands on for complex flows.
  • Partner with Development Leads to ensure technical specifications are testable and that acceptance criteria include measurable verification and rollback conditions.
  • Integrate automated tests into CI/CD where feasible and provide rapid, trustworthy feedback on modernization changes.
  • Drive defect root cause analysis and distinguish application defects, environment issues, test data issues, dependency incompatibility and AI agent errors.
  • Track escaped defects, automation coverage, execution reliability, agent generated test quality, rework, and regression effectiveness; use findings to improve skills/agents.

Required Skills:

  • Strong SDET/quality engineering background with hands on automation of APIs, integrations, UI and end to end enterprise workflows.
  • Demonstrated use of AI/agentic tools to generate, refine, review, or maintain test scenarios and automation not merely general chatbot usage.
  • Experience creating regression, system integration coverage for applications with incomplete or outdated test suites.
  • Strong knowledge of test strategy, risk-based testing, test design, traceability, defect management, root-cause analysis and CI/CD quality gates.
  • Hands on experience with modern automation tools such as Playwright, Cypress, Selenium, REST/API automation, or equivalent; ability to choose tools based on architecture.
  • Working knowledge of Java/.NET application behavior, databases/SQL, APIs, middleware, authentication/authorization, and enterprise integration patterns.
  • Understanding of LDAP and token-based authentication concepts sufficient to design security and role/authorization test scenarios.
  • Ability to evaluate nondeterministic AI outputs with repeatable acceptance criteria, structured evaluation, and human verification.

Preferred Skills:

  • Xray/Jira or comparable test-management tooling.
  • JUnit/TestNG and developer test frameworks, contract testing and service virtualization.
  • LLM evaluation/observability tooling and prompt/context testing.
  • Performance and resilience testing for upgraded runtime/infrastructure.
  • Regulated industry experience and audit-ready evidence/traceability.

More open positions

Windows Administrator

Work from home Full-time role

Dynamics 365 CRM Commercial Business Consultant

Work from home Full-time role

Full Stack .Net Developer (810929)

Work from home Full-time role

Expert AI Cybersecurity Architect

Work from home Full-time role

Senior Data Engineer with UNIX and Healthcare

Work from home Full-time role

Vice President of Business Development

Work from home Full-time role

Patient Access Specialist

Work from home Full-time role

V105C - Remote Legal Files Coordinator

Work from home Full-time role

Director, Critical Environments - Engineering

Work from home Full-time role

Sales Manager - Eastern Pa

Work from home Full-time role

Senior JD Edwards Analyst

Work from home Full-time role

Developer Relations Manager, CAE

Work from home Full-time role

F5 Engineer

Work from home Full-time role

Open Systems Architect - Legacy Modernization

Work from home Full-time role

ServiceNow Developer

Work from home Full-time role

Account Executive - LATAM (Colombia)

Work from home Full-time role

Cobot USA Sales Manager

Work from home Full-time role

Veteran Support Champion – Remote Customer Service Specialist – Empathy‑Driven, Analytical Problem‑Solver, AI‑Enabled Technical Excellence, Passion for Service – Join brighthush's Mission‑Driven Team

Work from home Full-time role

Senior/Lead SAP SuccessFactors Time Management Consultant (m/w/d)

Work from home Full-time role

Product Designer

Work from home Full-time role

Seasoned Remote Customer Experience Specialist & In‑Home Product Testing Analyst – Championing Consumer Insights & Data‑Driven Product Innovation at brighthush

Work from home Full-time role