Pay Growth
?
out of 5
Not enough data
Not enough info to score pay or growth
Rust Engineer
Job
LiteLLM
San Francisco, CA (In Person)
$230,000 Salary, Full-Time
Review key factors to help you decide if the role fits your goals.
Job Security
?
out of 5
Not enough data
Calculating job security score...
Total Score
76
out of 100
Average of individual scores
Skill Insights
Compare your current skills to what this opportunity needs—we'll show you what you already have and what could strengthen your application.
Job Description
Rust Engineer LiteLLM San Francisco, CA Job Details Full-time $200,000 - $260,000 a year 16 hours ago Benefits Dental insurance Vision insurance Qualifications Rust (programming language) Application Architecture Design (Architecture design skill) System performance optimization Scalable systems Infrastructure architecture design Production systems PostgreSQL Redis Network performance optimization Senior level Cross-functional collaboration Leadership Python Cross-functional communication System performance monitoring Full Job Description Rust Engineer LiteLLM is the world's most popular AI Gateway, trusted by top companies like Adobe, Netflix, and NASA. Our platform empowers developers by providing secure, reliable access to LLMs and adjacent services. We're looking for a Rust Engineer to own the migration of LiteLLM from Python to Rust and make us the fastest AI gateway ever built. About The Role You'll own LiteLLM's migration to Rust end to end. This is a high-stakes, high-visibility role: you'll plan the migration directly with the CTO, structure the codebase so it's ready for Rust, and lead a gradual, stability-first rollout. The work is fundamentally about performance. Every decision you make will move us toward being the lowest-latency, highest-throughput gateway in the category, without ever compromising the reliability our enterprise customers depend on. This is a single-owner mandate. You will be the person leading the entire Python-to-Rust migration. Responsibilities Own the end-to-end migration of LiteLLM from Python to Rust, from architecture through rollout. Plan the migration alongside the CTO, sequencing work to minimize risk to live, high-volume traffic. Design and execute a gradual rollout that holds stability as the top constraint while the migration progresses. Restructure the existing codebase so it's positioned for a clean, incremental move to Rust. Drive performance gains across latency, throughput, and resource efficiency at 1B+ requests/mo. Collaborate cross-functionally to ensure the migration aligns with backend priorities across performance, reliability, and security. What We're Looking For Deep, long-standing expertise in Rust. You've been writing production Rust for years and know it cold. Obsessive about performance. You care about latency and throughput at a level most engineers don't. Strong instinct for stability, with a track record of balancing ambitious change against reliability.