Find Jobs

Find Jobs Near You – Available Work in Your Location

Skip to job details

Back to Results

Apply for this opportunity

To apply for this job, you'll continue to an external website or email application.

Apply Offsite

Alchemy

Lead AI Engineer Agentic Test Automation

Pay: $70/hr

Posted: 3 weeks ago

Location: Tysons, VA (Hybrid)

Last Updated: 2 weeks ago

Hours: Full-Time

Expires: 10/1/2026

Career Insights for Software QA Engineer / Tester

See where this job fits in the broader career landscape. Knowing your career path helps you see what's possible from here.

Scorecard

Based on Virginia data

Review key factors to help you decide if this role fits your goals. How is this calculated?

Were these scores useful?

What they do

A Software QA Engineer or Tester designs and runs in-depth diagnostic tests to evaluate software and check for problems before new products are marketed. Pilots software and applies tests to check for errors and glitches.

$104,973 / year median in Virginia

-3% projected decline

Explore Career

Job Description

Required Technical Skills (Must-have) Gen

AI / LLM

+ agentic development Hands-on experience building LLM-powered agents (tool-using, multi-step reasoning, guardrails). Experience with prompting patterns , structured outputs (JSON schemas), evaluation, and reducing hallucinations. Ability to design agent workflows for: o Test generation/augmentation o Requirements review and completeness validation o Report generation and summarization GitHub platform + GHCP (Copilot) for engineering workflows Strong proficiency with GitHub Copilot in day-to-day development. Deep experience with GitHub platform capabilities: o GitHub Actions (CI/CD pipelines, reusable workflows, composite actions) o PR checks, branch protections, CODEOWNERS, templates Automation via GitHub APIs/webhooks (as needed) Test automation engineering (framework expertise) Advanced experience designing and implementing automation with: o Karate (API testing, contract-like checks, data-driven testing, mocks) o Playwright (UI automation, selectors strategy, parallelization, trace/video artifacts) Strong understanding of test design and coverage: o Happy path scenarios o Negative/validation scenarios o Edge/boundary scenarios o Data setup/teardown strategies and test isolation Cross-service reporting and data aggregation Proven ability to aggregate and normalize results from multiple microservices and multiple pipelines. Experience producing actionable automated reports (trend analysis, failure clustering, service correlation).

Pay:

From $70.00 per hour

Experience:

Generative AI and LLM-powered agents : 5 years (Required)

Test Automation Engineering :

7 years (Required)

Work Location:

Hybrid remote in Tysons, VA 22182