Performance Engineer

<div class="content-intro"><h2><strong>About Anthropic</strong></h2> <p>Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.</p></div><div> <div> <h2>About the role:</h2> </div> <div>Running machine learning (ML) algorithms at our scale often requires solving novel systems problems. As a Performance Engineer, you'll be responsible for identifying these problems, and then developing systems that optimize the throughput and robustness of our largest distributed systems. Strong candidates here will have a track record of solving large-scale systems problems and will be excited to grow to become an expert in ML also.</div> </div> <h2>You may be a good fit if you:</h2> <ul> <li>Have significant software engineering or machine learning experience, particularly at supercomputing scale</li> <li>Are results-oriented, with a bias towards flexibility and impact</li> <li>Pick up slack, even if it goes outside your job description</li> <li>Enjoy pair programming (we love to pair!)</li> <li>Want to learn more about machine learning research</li> <li>Care about the societal impacts of your work</li> </ul> <h2>Strong candidates may also have experience with:&nbsp;</h2> <ul> <li>High performance, large-scale ML systems</li> <li>GPU/Accelerator programming</li> <li>ML framework internals</li> <li>OS internals</li> <li>Language modeling with transformers</li> </ul> <h2>Representative projects:</h2> <ul> <li>Implement low-latency high-throughput sampling for large language models</li> <li>Implement GPU kernels to adapt our models to low-precision inference</li> <li>Write a custom load-balancing algorithm to optimize serving efficiency</li> <li>Build quantitative models of system performance</li> <li>Design and implement a