Infrastructure Software Engineer, Enterprise GenAI

About Scale AI

Scale AI develops reliable AI systems for critical decisions. The company provides data and technologies powering leading models, helping enterprises and governments build and deploy impactful AI applications. Notable clients include Meta, Cisco, Mayo Clinic, and U.S. government agencies.

About the role

Scale GP is an enterprise-grade Generative AI platform providing APIs for knowledge retrieval, inference, evaluation, and agents. As an Infrastructure Software Engineer, you will build the multi-cloud systems enabling Scale GP deployment and customer integrations.

Responsibilities

• Design multi-cloud systems enabling Scale GP platform deployment across major cloud providers
• Create custom integrations linking Scale's platform with customer data environments and internal systems
• Partner with platform and product teams plus customers to build scalable infrastructure
• Execute experiments with velocity and quality
• Contribute across the entire product lifecycle
• Master emerging technologies rapidly

Requirements

• 4+ years post-graduation engineering experience
• Background scaling products at hypergrowth startups
• Experience with LLMs, vector databases, or modern AI technologies
• Proficiency in Python or JavaScript/TypeScript plus SQL
• Kubernetes expertise
• Multi-cloud platform experience (AWS, Azure, GCP)
• Strong communication abilities for technical and non-technical audiences

Compensation

Base salary: $179,400 - $224,250 USD

Logistics

• Hybrid: 3 days per week in-office (SF or NY)

Benefits

Comprehensive health, dental, vision coverage, retirement benefits, learning stipend, generous PTO, potential commuter stipend, equity compensation.