Infrastructure Software Engineer, Enterprise GenAI at Scale AI

About Scale AI

Scale AI develops reliable AI systems for critical decisions. The company provides data and technologies powering leading models, helping enterprises and governments build and deploy impactful AI applications. Notable clients include Meta, Cisco, Mayo Clinic, and U.S. government agencies.

About the role

Scale GP is an enterprise-grade Generative AI platform providing APIs for knowledge retrieval, inference, evaluation, and agents. As an Infrastructure Software Engineer, you will build the multi-cloud systems enabling Scale GP deployment and customer integrations.

Responsibilities

Design multi-cloud systems enabling Scale GP platform deployment across major cloud providers

Create custom integrations linking Scale's platform with customer data environments and internal systems

Partner with platform and product teams plus customers to build scalable infrastructure

Execute experiments with velocity and quality

Contribute across the entire product lifecycle

Master emerging technologies rapidly

Requirements

4+ years post-graduation engineering experience

Background scaling products at hypergrowth startups

Experience with LLMs, vector databases, or modern AI technologies

Proficiency in Python or JavaScript/TypeScript plus SQL

Kubernetes expertise

Multi-cloud platform experience (AWS, Azure, GCP)

Strong communication abilities for technical and non-technical audiences

Compensation

Base salary: $179,400 - $224,250 USD

Logistics

Hybrid: 3 days per week in-office (SF or NY)

Benefits

Comprehensive health, dental, vision coverage, retirement benefits, learning stipend, generous PTO, potential commuter stipend, equity compensation.