AI Assurance Engineer

AI Assurance Engineer

MANTECH - 3.9

Washington, DC Job Details Full-time 15 hours ago Qualifications TS/SCI with Polygraph Model evaluation Full Job Description MANTECH seeks motivated, career, and customer-oriented AI Assurance Engineer for a new initiative within the National Capital Region. This effort supports the rapid design, deployment, operation, and sustainment of enterprise-scale AI, data, and mission platform capabilities across cloud, edge, and classified operational environment. This role supports mission analytics, AI-enabled workflows, predictive analytics, and operational intelligence applications. You will translate raw data into actionable insights, focusing on data science solutions for the mission. Responsibilities include but are not limited to: Support AI testing, evaluation, verification, and validation (TEVV) activities for operational AI systems. Design and conduct adversarial testing, bias analysis, and prompt injection testing. Utilize and develop automated AI evaluation frameworks and continuous validation workflows. Execute regression validation and responsible AI testing to ensure model integrity. Provide operational assurance by ensuring AI systems meet performance, safety, and security requirements.

Minimum Qualifications:

Bachelor's degree in Engineering, Computer Science, or a related technical field. 4 or more years of relevant experience in AI testing, quality assurance, or model validation. Experience in developing or utilizing AI evaluation frameworks and metrics. Understanding of AI safety, bias, and responsible AI principles. Demonstrated ability to implement continuous validation and operational assurance workflows.

Preferred Qualifications:

Experience with AI red teaming and advanced adversarial testing techniques. Prior experience developing automated evaluation pipelines. Master's degree in a relevant technical field.

Clearance Requirements:

For onsite work, a TS/SCI clearance with polygraph will be required.

Physical Requirements:

The person in this position must be able to remain in a stationary position 50% of the time. Frequently communicates with co-workers, management, and customers, which may involve delivering presentations. Constantly operates a computer and other office productivity machinery.