Principal Engineer - Distributed AI Systems Architecture (Heterogeneous Compute)

Job Listing ID:

4479475

Job Title:

Principal Engineer

• Distributed AI Systems Architecture (Heterogeneous Compute)

Application Deadline:

Open Until Filled

Job Location:

Hillsboro

Date Posted:

04/24/2026

Hours Worked Per Week:

Not Provided Shift:

Not Provided Duration of Job:

Either Full or Part Time, more than 6 months You may contact this employer directly. (Obtain the contact information to print or add to your jobs.)

Job Summary:

Job Details:

Job Description:

We are seeking a Principal Engineer to define and architect the next generation of distributed AI systems across heterogeneous compute platforms, including CPUs, GPUs, IPUs/FNICs/FNICs, and emerging dataflow accelerators. This role focuses on one of the hardest problems in modern computing: How to dynamically execute and optimize large-scale AI computation graphs across diverse hardware while managing state, locality, and performance at system scale. You will operate at the intersection of systems architecture, high-performance computing, and AI infrastructure-defining the execution model, runtime abstractions, and placement strategies that turn a rack of heterogeneous devices into a coherent, programmable system. Key Responsibilities Dynamic Execution of Distributed Computation Graphs

• Define a runtime model for executing AI workloads as distributed computation graphs across heterogeneous resources
• Design abstractions for graph representation, dependencies, and execution semantics
• Enable dynamic scheduling and execution across CPUs, GPUs/specialized accelerators, and IPUs/FNICs., and specialized accelerators Stateful Scheduling and Memory-Centric Architecture
• Architect systems where state (e.g., KV cache) is a first-class concern in scheduling and execution
• Distributed Inferencing solution: Define models for data locality, memory hierarchy, and state ownership
• Optimize for minimal data movement and efficient access to distributed state Graph Introspection and Automated Partitioning
• Develop mechanisms to analyze AI computation graphs and classify stages by: o compute intensity o memory bandwidth requirements o communication cost o latency sensitivity
• Drive automated or semi-automated partitioning of workloads across heterogeneous compute Integration of Specialized Accelerators
• Architect frameworks that treat specialized accelerators (e.g., dataflow engines) as first-class execution targets
• Define execution boundaries, data exchange models, and integration strategies across device classes
• Enable interoperability across diverse compute paradigms without sacrificing performance MoE-Aware Execution and Adaptive Placement
• Design runtime strategies for Mixture-of-Experts (MoE) models, including: o expert placement o routing locality o load balancing vs data movement trade-offs
• Enhance existing frameworks for MOE and optimize communication path with IPUs/FNICs and compute path with Intel Accelerators.
• Enable adaptive execution based on real-time system signals (latency, utilization, skew) Adaptive Runtime and Feedback-Driven Optimization
• Define observability and telemetry models for distributed AI execution
• Build feedback loops that continuously optimize placement, scheduling, and resource utilization
• Drive system-level performance across latency, throughput, and efficiency metrics

Qualifications:

Minimum Qualifications:

• Bachelor's or BS degree in Computer Science, Software Engineering, or a related specialized field, or equivalent experience per business needs.
• 12-plus years of experience with a Bachelor's degree
• Proven expertise in defining and implementing software architectures for AI frameworks, protocols, and algorithms.
• Deep experience in systems architecture, high-performance computing, or distributed systems
• Strong background in parallel or data-parallel computation models
• Experience with heterogeneous compute environments (CPU, GPU, DSP, or accelerators)
• Proven ability to design end-to

•..

Job Classification:

Computer Occupations, All Other Access our statewide or regional occupation report for more information about wages, employment outlooks, skills, training programs, related occupations, and more. Compensation

Salary:

Not Provided Job Requirements

Experience Required:

 See Job Summary

Education Required:

None

Minimum Age:

N/A Gender:

N/A