Senior Engineer II - Agent Harness & Workflow Engineering
Job
IBM
San Jose, CA (In Person)
Full-Time
Review key factors to help you decide if the role fits your goals.
Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
43
out of 100
Average of individual scores
Skill Insights
Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
- Introduction
- At IBM Software, we transform client challenges into solutions.
- Your role and responsibilities
- We are an agent-first engineering team building intelligent infrastructure automation at scale.
What You'll Do
- Build and evolve type-safe, composable AI pipelines for intent analysis, planning, knowledge enrichment, and infrastructure generation
- Extend pipeline routing and outputs across Z, Power, and Cloud platforms (Terraform, Ansible, Pulumi, native APIs)
- Design context management, telemetry, and production observability for multi-step AI workflows
- Own a markdown-based workflow engine supporting parallel execution, rollback, approvals, and cross-domain orchestration
- Develop and scale a plugin-based tool provider system, integrating Power and Cloud APIs with secure session management
- Advance a robust evaluation framework (LLM-as-judge, regression detection, eval-as-CI) to ensure AI-generated outputs are production-safe
- Help build a cross-platform workflow catalog used by humans and AI agents for discovery, routing, and execution
- Extend the agent-to-agent (A2A) interface for capability discovery and delegation as the platform scalesWhat the First 90 Days Look LikeMonth 1: Onboard onto the Go agent codebase.
Month 2: Extend the eval corpus — add new cases covering under-tested pipelines (iterative planning, deep research, workflow composition). Begin workflow catalog design — metadata schema, platform tagging, versioning model. Prototype a Power tool provider interface based on Power HMC API surface.
Month 3: Ship workflow catalog MVP with the existing Z workflows cataloged and tagged. Deliver first Power or Cloud tool provider prototype. Implement eval-as-CI with quality gates. Begin cross-platform pipeline routing — intent analysis that distinguishes Z, Power, and Cloud prompts and routes to the correct pipeline/tool provider combination.
- Required technical and professional expertise
- Strong Go engineering. The entire harness is Go — pipeline composition, workflow execution, tool dispatch, eval framework, agent protocol server. You need to be productive in Go immediately.
- You've built execution systems. Workflow engines, pipeline frameworks, DAG executors, orchestration infrastructure — you understand step composition, error propagation, checkpoint/rollback, and what it takes to make multi-step execution reliable.
- LLM integration experience. You've worked with LLM APIs in production — prompt construction, structured output parsing, function/tool calling, context window management. You understand the practical challenges of making LLM outputs reliable.
- You care about quality measurement. You've built or maintained evaluation, testing, or quality systems. You understand regression detection, baseline management, and why "it works on my machine" isn't good enough for infrastructure automation.
- Preferred technical and professional experience
- You don't need all of these coming in. The team will bring you up to speed:
- IBM Z, Power, and Cloud infrastructure APIs and the operational domain knowledge encoded in our workflows
- Terraform, Ansible, and infrastructure-as-code patterns — what correct generated infrastructure code looks like
- Our pipeline composition model, scripted workflow engine, and tool provider plugin systemIBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer.
Similar jobs in San Jose, CA
Rehab Without Walls Neuro Rehabilitation
San Jose, CA
Posted2 days ago
Updated15 hours ago
Similar jobs in California
U.S. Customs and Border Protection
Wildomar, CA
Posted2 days ago
Updated15 hours ago
Domino's
Torrance, CA
Posted2 days ago
Updated15 hours ago
Hammond - Special Needs assistant
Newcastle, CA
Posted2 days ago
Updated15 hours ago