Build and scale evaluation frameworks, benchmarks, and simulation-backed validation systems for agentic AI used in autonomous space mission planning. Develop SDKs, evaluation harnesses, metrics, benchmark scenarios, and failure-analysis tooling for multi-step, tool-using, and autonomous AI workflows. Translate astrodynamics and mission concepts into executable scenarios while partnering with AI researchers and domain experts. Ensure robust engineering through testing, documentation, reproducibility, and maintainable design. The summary above was generated by AI Meet Slingshot At Slingshot Aerospace, we're on a mission to make space safer and more secure for everyone. Our work directly impacts global security, disaster response, climate monitoring, and the critical infrastructure that connects our world. We're a team of builders, thinkers, and problem-solvers who believe that the next generation of space operations will be powered by better data and smarter software. We move fast, we're not afraid to fail, and we believe the best ideas can come from anywhere—whether you're in engineering, sales, product, or operations. If you want to work on something that truly matters, with people who care deeply about the impact we're making and help shape the future of an industry that's just getting started, you're in the right place. Role is based in Colorado Springs, CO, and Slingshot will provide relocation assistance! What You'll Be Launching As a Senior AI Engineer focused on Agentic Evaluation and Verification and Validation (V&V), you will join the AI and Data Science team within Slingshot's Research and Development organization. You will contribute to advancing how intelligent systems are evaluated and validated for mission-critical space operations. This role focuses on building and scaling evaluation frameworks, benchmarks, and simulation-backed validation systems for agentic AI systems, including multi-step, tool-using, and autonomous decision-making workflows powered by LLMs and reinforcement learning. Your work will directly support the development of reliable and trustworthy autonomous mission planning systems. You will partner closely with AI researchers and domain experts to translate real-world mission concepts into structured, testable evaluation systems. Your Mission (Should you choose to accept it) Extend and maintain Slingshot's V&V SDK and evaluation framework for simulation-backed validation of agentic AI systems Design and implement agent-level and end-to-end evaluations, including benchmark scenarios, scoring logic, and experiment harnesses Build benchmark scenarios and tooling that measure planning, reasoning, and operational performance for autonomous mission planning systems Translate astrodynamics and mission-domain concepts into executable evaluation scenarios and simulation configurations Develop reusable SDK interfaces, adapters, and evaluation utilities that connect V&V systems, TALOS benchmarks, and agent workflows Define and apply metrics for capability evaluation, failure analysis, regression detection, and comparative benchmarking Partner with cross-functional teams to identify evaluation needs and contribute to improving coverage of critical capabilities Contribute to best practices for evaluating complex, autonomous AI systems Uphold strong engineering standards through testing, documentation, reproducibility, and maintainable system design Pre-flight Checklist 6+ years of experience in software engineering, machine learning engineering, applied AI, or equivalent experience Strong Python engineering skills with experience building SDKs, libraries, or evaluation tooling Experience designing evaluation frameworks, benchmarks, metrics, or test harnesses for AI/ML systems Ability to analyze system behavior, identify failure modes, and evaluate performance in complex autonomous or semi-autonomous systems Familiarity with modern agent frameworks, orchestration patterns, or protocol-based integrations Experience working in cross-functional, multidisciplinary teams Strong written and verbal communication skills Bachelor's degree in a relevant science or engineering field, or equivalent experience Must be a U.S. citizen and possess an active Top Secret / SCI (TS/SCI) clearance. Bonus Cargo Experience in autonomous systems such as self-driving or ADAS, including perception, planning, simulation, or safety validation Experience developing or evaluating agentic AI systems, including multi-step, tool-using, or autonomous workflows (e.g., LLM-based agents, planning agents, or reinforcement learning approaches) Experience with reinforcement learning systems and simulation-based evaluation Familiarity with benchmark design, experiment tracking, and trace-based evaluation workflows Experience with orchestration frameworks such as LangGraph or similar tools Knowledge of astrodynamics, orbital mechanics, or spacecraft mission planning Experience translating mission or operational concepts into measurable evaluation scenarios Familiarity with physics-based simulation, trajectory analysis, or space-domain modeling Experience with observability and experiment tooling such as MLflow, Opik, or similar platforms Experience transitioning advanced research systems into production environments

US-based Candidates:

we are currently only able to hire residents of the following U.S.

states:

AL, AZ, CA, CO, DC, FL, GA, HI, IL, IN, KS, MA, MD, MI, MN, MO, MT, NC, NJ, NM, NV, NY, OH, OK, OR, RI, TN, TX, UT, VA, WA, WI, WV

We are unable to consider candidates residing in other U.S. states at this time.

Internationally-based Candidates:

we are currently only able to hire residents of the following locations: United Kingdom. We are unable to consider candidates residing in other countries at this time. Equity, Diversity & Inclusion are key to our success. We are an Equal Opportunity Employer and our employees are people with different strengths, experiences, and backgrounds, who share a passion for creating a safer, more connected world. Diversity not only includes race and gender identity, but also national origin, citizenship, sex, color, veteran status, disability, genetic information, or any other protected characteristic that is part of one's identity. All of our employees' points of view are key to our success, and we embrace individuality. Read Full Description Slingshot Aerospace Colorado Springs, Colorado, USA Office 5475 Tech Center Dr. Suite 225, Colorado Springs, CO, United States, 80919 Slingshot Aerospace Fort Collins, Colorado, USA Office 5042 Technology Parkway STE 100, Fort Collins, United States Similar Jobs Vantor Software Engineer 5 Days Ago In-Office Westminster, CO, USA 145K-205K Annually Senior level 145K-205K Annually Senior level Aerospace

• Artificial Intelligence
• Computer Vision
• Software
• Analytics
• Defense
• Big Data Analytics Build and integrate secure AI assistants and chatbots into geospatial intelligence and mission-support applications.

Develop LLM workflows using RAG, prompt orchestration, tool calling, and conversational context; connect AI services to enterprise data sources and APIs; and enforce access controls, provenance, auditing, and safety measures. Deploy and operate services in Kubernetes and OpenShift, including classified or disconnected environments, while evaluating AI quality, security, latency, and usability.

Top Skills:

Agent Workflows Agile C++ Ci/Cd Elasticsearch Embeddings Function Calling Gis Git Go Java JavaScript Knowledge Graphs Kubernetes Large Language Models Mcp Microservices Python React Red Hat Openshift Rest Apis Retrieval-Augmented Generation Typescript Vector Search Credence Software Engineer One Month Ago In-Office Denver, CO, USA 155K-200K Annually Senior level 155K-200K Annually Senior level Information Technology Senior AI Software Engineer responsible for designing, developing, and deploying generative AI, LLM-powered, and agentic AI systems. Lead system architecture, implement secure cloud-native deployments and CI/CD, collaborate cross-functionally, monitor and optimize production AI, mentor engineers, and enforce technical rigor and documentation for mission-focused federal solutions.

Top Skills:

Agent2Agent Protocol Agentcore Amazon Bedrock Anthropic Bedrock Agents Claude Code Cline Crewai Fastapi Gemini Gitlab Ci Google Vertex Ai Jest Langchain Langgraph Mastra Next.

Js Nx Openai Playwright Pydantic Python Strands Typescript Unstructured Uv Vercel Ai Sdk Vite Vs Code Eve Architect An Hour Ago Easy Apply Remote or Hybrid United States Easy Apply 140K-170K Annually Entry level 140K-170K Annually Entry level Legal Tech

• Software
• Generative AI Own end-to-end intake onboarding for plaintiff law firms, including voice-agent customization, call flows, firm knowledge bases, transfer rules, scoring, phone integrations, CRM/DMS handoffs, and e-signature setup.

Establish onboarding standards, document repeatable processes, train internal teams, and manage intake-focused accounts. The role requires translating legal intake expertise into configurable AI workflows while collaborating with customer success, integration engineering, and law firms.

Top Skills:

AI Clio Grow CRM Dms E-Signature Lead Docket Ringcentral Smart Advocate Voice Ai What you need to know about the Colorado Tech Scene With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech Number of Tech Workers:

260,000; 8.5% of overall workforce (2024 CompTIA survey)

Major Tech Employers:

Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3

Key Industries:

Software , artificial intelligence , aerospace , e-commerce , fintech , healthtech

Funding Landscape:

$4.9 billion in VC funding in 2024 (Pitchbook)

Notable Investors:

Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures Research Centers and Universities:

Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute