Technical Program Manager, Inference Performance

<div class="content-intro"><h2><strong>About Anthropic</strong></h2> <p>Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.</p></div><h2><strong>About the Role&nbsp;</strong></h2> <p>As a Technical Program Manager for Inference, you'll be the critical bridge between our inference systems and the broader organization. You'll drive strategic initiatives across inference runtime and accelerator performance—coordinating model launches, managing cross-platform dependencies, and ensuring reliability across multiple hardware targets. This role is essential for keeping our most contended infrastructure teams shipping effectively while Research, Product, and Safety all depend on their output.</p> <h2 class="heading"><strong>Responsibilities:</strong></h2> <ul> <li><strong>Systems Integration &amp; Coordination</strong>: Lead cross-functional initiatives for new infrastructure integration, establishing clear ownership, timelines, and communication channels between teams. Drive end-to-end planning for major infrastructure transitions including platform modernization and new tech adoption.&nbsp;</li> <li><strong>Performance &amp; Efficiency:</strong> Partner with engineering teams to identify optimization opportunities, track performance metrics, and prioritize work that unlocks capacity gains. Coordinate across runtime and accelerator layers to ensure efficiency wins ship without compromising reliability.</li> <li><strong>Launch Coordination:</strong> Drive end-to-end readiness for model and feature launches across multiple hardware platforms. Establish processes for cross-platform validation, manage launch timelines, and ensure smooth handoffs between runtime, accelerator, and downstream teams.</li> <li><strong