Software Engineer, Data Infrastructure

<p>Scale AI is seeking a highly skilled and motivated Software Engineer to join our dynamic Public Sector Engineering team. As a part of this team, you will play a critical role in supporting Scale’s government customers by scoping and developing onsite solutions. Our scalable, high-performance platform is the foundation for these customer solutions, and your expertise will be instrumental in designing and implementing systems that can handle interactions with existing customer systems to help our products integrate into existing customer workflows.&nbsp;&nbsp;&nbsp;</p> <h3><strong>The Role</strong></h3> <ul> <li>We are looking for an exceptional <strong>Senior Software Engineer</strong> to architect and build the foundational data infrastructure that will serve as the brain of a project ecosystem.</li> <li>We are not looking for someone to stitch together off-the-shelf data frameworks. You will be responsible for designing highly novel data models and processing pipelines capable of handling massive quantities of output data from complex simulations.</li> <li>At the core of this role is the challenge of building a foundational <strong>data ensemble</strong>—a unified architecture that seamlessly aggregates, structures, and stages diverse sources of simulation outputs and user inputs. Your systems will manage enormous batch throughput jobs with strict, minimal latency requirements, ensuring that downstream AI systems and language models have the exact context they need to actionably reason over complex, multi-dimensional scenarios.</li> </ul> <h3><strong>Key Responsibilities</strong></h3> <ul> <li><strong>Architect the Data Ensemble:</strong> Design and implement the architecture to ensemble various sources of injected context (deeply structural simulation data, historical game states, and dynamic user inputs) into a unified, highly queryable format optimized for LLM consumption.</li> <li><strong>Massive Batch Infrastructure:</strong> Build highly scalable, resilie