The Role Build and operate scalable AI platform infrastructure enabling secure, reliable access to foundation models and AI agents. Responsibilities include developing model gateways, provider integrations, routing, usage controls, observability, governance, and self-service platform capabilities. The role involves architecting distributed systems, improving reliability and security, collaborating across engineering and product teams, mentoring engineers, and establishing high-quality engineering practices. Summary Generated by Built In As a Staff Software Engineer on Aledade's AI Core Platform team, you will help build and operate the shared infrastructure that enables applications and AI agents across Aledade to securely and reliably access foundation models. You will work on the platform capabilities behind model access, including model gateways, cloud AI services, provider integrations, routing and fallback, usage controls, observability, reliability, and model governance. We're looking for engineers who think beyond implementing individual features and consider the full lifecycle of production platform systems: architecture, scalability, failure modes, security, observability, operational readiness, cost, and developer experience. You will help evolve the platform as AI adoption grows across Aledade, building reusable and self-service capabilities rather than one-off solutions. You will work closely with engineers, product partners, security, infrastructure teams, and teams building AI applications and agents. Successful engineers in this role are comfortable operating in ambiguous problem spaces, making pragmatic technical decisions, and building secure, maintainable, observable, and resilient systems.

Primary Duties:

Identify and develop scalable and performant solutions. Work across discipline to shape product strategy and execution. Develop the foundations of code architecture and quality. Mentor and coach engineers. Set and uphold the standard for engineering processes to support high-quality engineering.

Minimum Qualifications:

BS/BTech (or higher) in Computer Science, Engineering or a related field required. 8+ years of production-level experience as an engineer building highly scalable systems. 4+ years of experience acting as a trusted technical decision-maker in a team setting, solving for short-term and long-term business value. 4+ years of experience working with SQL or other database querying languages on large multi-table data sets. Experience architecting, developing, and deploying large-scale distributed systems at scale. Experience with cloud technologies, e.g., AWS, Azure, GCP. Experience building continuous integration and continuous development (CI/CD) pipelines. Strong familiarity with server-side web technologies (eg: Java, Python, Scala, C#, C++, Go).

Preferred KSAs:

AI Infrastructure & Model Platform:

Experience building or operating production platform infrastructure, distributed systems, developer platforms, or other high-availability shared services. Experience with LLM infrastructure, model gateways, foundation model APIs, or managed AI platforms such as AWS Bedrock, Azure OpenAI, Google Vertex AI, or similar technologies. Strong experience with cloud infrastructure, preferably AWS, and technologies such as Kubernetes, containers, and infrastructure as a code. Experience designing observability and operational practices for production systems, including metrics, distributed tracing, logging, alerting, SLOs, dashboards and failure handling. Experience designing APIs and self-service platform capabilities used by other engineering teams. Experience with Identity, access control, secrets management, security and governance for shared infrastructure. Experience with cost management, usage attribution, quotas, budgets, or capacity management for shared platforms. Experience operating systems that handle sensitive or regulated data. Ability to evaluate architectural tradeoffs across reliability, performance, security, cost, scalability and developer experience.

Physical Requirements:

Sitting for prolonged periods of time. Extensive use of computers and keyboard. Occasional walking and lifting may be required. Read Full Description Skills Required Bachelor's degree or higher in Computer Science, Engineering, or a related field 8+ years of production-level engineering experience building highly scalable systems 4+ years acting as a trusted technical decision-maker in a team setting 4+ years working with SQL or other database querying languages on large multi-table datasets Experience architecting, developing, and deploying large-scale distributed systems Experience with cloud technologies such as AWS, Azure, or GCP Experience building CI/CD pipelines Strong familiarity with server-side web technologies, including Java, Python, Scala, C#, C++, or Go Experience with production platform infrastructure, distributed systems, developer platforms, or high-availability shared services Experience with LLM infrastructure, model gateways, foundation model APIs, or managed AI platforms such as AWS Bedrock, Azure OpenAI, or Google Vertex AI Strong experience with cloud infrastructure, preferably AWS, including Kubernetes, containers, and infrastructure as code Experience designing observability and operational practices for production systems Experience designing APIs and self-service platform capabilities for engineering teams Experience with identity, access control, secrets management, security, and governance for shared infrastructure Experience with cost management, usage attribution, quotas, budgets, or capacity management for shared platforms Experience operating systems handling sensitive or regulated data Ability to evaluate tradeoffs across reliability, performance, security, cost, scalability, and developer experience Aledade Compensation & Benefits Highlights The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Aledade and has not been reviewed or approved by Aledade. About This Summary Fair & Transparent Compensation — Pay is often characterized as fair or pretty good for the work, with occasional remarks that compensation is among the best experienced in a career. Leave & Time Off Breadth — Time off provisions stand out, including a strong PTO allotment early on and an additional long-tenure sabbatical benefit. Parental & Family Support — Paid parental leave is positioned as a meaningful, broadly applicable benefit for new parents. Learn more about Aledade's Compensation & Benefits → Aledade Insights What's It Like to Work at Aledade? Aledade Culture & Values Aledade Career Growth & Development What's the Work-Life Balance Like at Aledade? Aledade Leadership & Management Aledade Company Growth, Stability & Outlook View all jobs at Aledade View Aledade Profile Report Job