Tallo logoTallo logo

Senior AI Architect - Enterprise Integrations

Job

IBM

San Francisco, CA (In Person)

Full-Time

Posted 2 days ago (Updated 10 hours ago) • Actively hiring

Expires 6/13/2026

Apply for this opportunity

This job application is on an outside website. Be sure to review the job posting there to verify it's the same.

Review key factors to help you decide if the role fits your goals.
Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
100
out of 100
Average of individual scores

Were these scores useful?

Skill Insights

Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.

Job Description

  • Introduction
  • A career in IBM Consulting is built on long-term client relationships and close collaboration worldwide.
You'll work with leading companies across industries, helping them shape their hybrid cloud and AI journeys. With support from our strategic partners, robust IBM technology, and Red Hat, you'll have the tools to drive meaningful change and accelerate client impact. At IBM Consulting, curiosity fuels success. You'll be encouraged to challenge the norm, explore new ideas, and create innovative solutions that deliver real results. Our culture of growth and empathy focuses on your long-term career development while valuing your unique skills and experiences.
  • Your role and responsibilities
  • About the RoleWe are seeking a Senior AI Architect
  • Enterprise Integrations to join our growing AI practice.
As demand for intelligent, connected enterprise solutions accelerates, we are building out a specialized capability in AI-native architecture and agentic system design. This is a senior, client-facing role where you will provide thought leadership, shape practice offerings, and lead delivery on high-impact AI integration engagements.

You will be the subject matter expert at the intersection of AI agents and enterprise systems — designing and building the connective tissue that makes AI solutions work in the real world
  • What You'll DoThought Leadership & Practice Development
  • Serve as an internal champion for AI integration architecture strategy, helping to define and grow this capability within the firm
  • Develop points of view, reference architectures, and reusable assets that accelerate client delivery
  • Mentor and upskill other architects and consultants on AI integration patterns and emerging standardsClient Engagement & Solution Architecture
  • Lead discovery, design, and architecture sessions with clients to define AI integration strategies
  • Translate complex business requirements into scalable, secure, and maintainable AI-powered solutions
  • Provide cloud and LLM consumption cost estimates, optimizing for cost-effective architecture through fit-for-purpose model selection, efficient prompting & caching, and scalable infrastructure design
  • Present architectural recommendations to executive and technical stakeholders with clarity and confidence
  • Lead cross-functional development teams to deliver enterprise-grade, production-ready AI solutions, ensuring alignment to architecture standards, scalability, and operational excellenceTechnical Delivery
  • Architect and implement integrations between AI agents and enterprise systems including CRMs, ERPs, data platforms, and third-party APIs
  • Establish a semantic data layer that standardizes and contextualizes enterprise data, enabling AI agents to reliably discover, interpret, and interact with systems & data
  • Define patterns for agent orchestration, tool calling, memory management, and human-in-the-loop workflows
  • Design and build Model Context Protocol (MCP) gateway & servers that expose enterprise data, tools, and APIs as structured context for AI agents
  • Ensure solutions meet enterprise standards for security, observability, and reliability
  • This role can be performed from anywhere in the US.
  • Required technical and professional expertise
  • What You BringRequired Skills & Experience
  • 8+ years of experience in application or solution architecture, with at least 2+ years focused on AI/ML systems
  • Hands-on experience designing and building MCP (Model Context Protocol) servers
  • Proven experience integrating AI agents with enterprise systems and workflows
  • Deep understanding of agentic AI frameworks (e.g., LangChain, LangGraph, AutoGen, CrewAI, or similar)
  • Strong knowledge of API design (REST, GraphQL), event-driven architecture, and enterprise integration patterns
  • Experience working with LLM providers (OpenAI, Anthropic, Azure, IBM, AWS, Google, etc.) and their APIs
  • Proficiency in Python and/or TypeScript/JavaScript for building AI integration solutions
  • Consulting or professional services experience — comfortable owning client relationships and leading engagements
  • Preferred technical and professional experience
  • Preferred Skills
  • Familiarity with cloud platforms (Azure, AWS, or GCP) and cloud-native deployment patterns
  • Experience with RAG (Retrieval-Augmented Generation) architectures and vector databases
  • Background in enterprise middleware or iPaaS platforms (MuleSoft, Boomi, Azure Integration Services)
  • Knowledge of AI security considerations including prompt injection, data governance, and access controlsIBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

Similar remote jobs

Similar jobs in San Francisco, CA

Similar jobs in California