Software Engineer, Inference AI/ML

<div class="content-intro"><div> <div> <div class="gmail_quote"> <div> <div><span id="m_1770241969069985273m_-2746164444908759431gmail-docs-internal-guid-131e4fb0-7fff-b4e9-ff50-e8cf32449b1b">CoreWeave is The Essential Cloud for AI™. Built for pioneers by pioneers, CoreWeave delivers a platform of technology, tools, and teams that enables innovators to build and scale AI with confidence. Trusted by leading AI labs, startups, and global enterprises, CoreWeave combines superior infrastructure performance with deep technical expertise to accelerate breakthroughs and turn compute into capability. Founded in 2017, CoreWeave became a publicly traded company (Nasdaq: CRWV) in March 2025. Learn more at&nbsp;<a href="http://www.coreweave.com/" target="_blank" data-saferedirecturl="https://www.google.com/url?q=http://www.coreweave.com&amp;source=gmail&amp;ust=1762613132717000&amp;usg=AOvVaw3D-UOhNaqEvF5BEWxjYyAU">www.coreweave.com</a>.</span></div> </div> </div> </div> </div></div><h3><span style="text-decoration: underline;"><strong>What You’ll Do:</strong></span></h3> <p>Join the Inference team to ship production features that improve latency, reliability, and cost for model serving on our GPU platform. As an IC1, you’ll implement well-scoped changes, learn our operational practices, and grow quickly with mentorship from experienced engineers.</p> <h3><span style="text-decoration: underline;"><strong>About the role:</strong></span></h3> <ul> <li>Implement well-scoped features and fixes in Python/Go/C++ for model-serving services (e.g., Triton, vLLM, TensorRT-LLM, Ray Serve).</li> <li>Write tests, code comments, and short design docs; participate in code reviews.</li> <li>Add basic metrics and dashboards; assist with alarms and runbooks.</li> <li>Follow on-call runbooks and learn incident response in a guided rotation.</li> <li>Contribute to performance experiments (e.g., request batching, concurrency, caching) with guidance.</li> </ul> <h3><span style="text-decoration: unde