Find Jobs
Find Jobs Near You – Available Work in Your Location
Skip to job details
PG
PRIMUS Global Services Inc.
AI Automation Engineer LLM Evaluation, Onsite - 70000
Career Insights for Artificial Intelligence Engineer (General)
See where this job fits in the broader career landscape. Knowing your career path helps you see what's possible from here.
Scorecard
Based on Washington data
Review key factors to help you decide if this role fits your goals. How is this calculated?
What they do
An Artificial Intelligence Engineer develops, tests, and deploys artificial intelligence models. May work closely with data software engineers and data professionals to train and implement AI models into existing systems or develop new applications.
$145,647 / year median in Washington
Job Description
AI Automation Engineer LLM Evaluation, Onsite We have an immediate need for an experienced AI Test Automation Engineer with strong expertise in GenAI, Agentic AI, LLM evaluation, and Python-based test automation to design and build end-to-end AI testing frameworks. This is an onsite position based in Bellevue, WA for a candidate with strong hands-on experience in LLM evaluation frameworks such as Promptfoo, DeepEval, and Ragas, along with Python automation using PyTest and Unittest. The ideal candidate will have experience developing automated test cases, validating LLM/model outputs against quality benchmarks, evaluating relevance, groundedness, and hallucination, and integrating AI evaluation pipelines into CI/CD workflows. For immediate consideration, please contact: