Infrastructure Software Engineer, Enterprise GenAI
Tech Stack
Agent Workflow
Design multi-cloud infrastructure enabling Scale GP agent platform deployment across AWS, Azure, and GCP; build custom integrations linking Scale's agent and retrieval platform with customer data environments.
About the Role
About Scale AI
Scale AI develops reliable AI systems for critical decisions. The company provides data and technologies powering leading models, helping enterprises and governments build and deploy impactful AI applications. Notable clients include Meta, Cisco, Mayo Clinic, and U.S. government agencies.
About the role
Scale GP is an enterprise-grade Generative AI platform providing APIs for knowledge retrieval, inference, evaluation, and agents. As an Infrastructure Software Engineer, you will build the multi-cloud systems enabling Scale GP deployment and customer integrations.
Responsibilities
- Design multi-cloud systems enabling Scale GP platform deployment across major cloud providers
- Create custom integrations linking Scale's platform with customer data environments and internal systems
- Partner with platform and product teams plus customers to build scalable infrastructure
- Execute experiments with velocity and quality
- Contribute across the entire product lifecycle
- Master emerging technologies rapidly
Requirements
- 4+ years post-graduation engineering experience
- Background scaling products at hypergrowth startups
- Experience with LLMs, vector databases, or modern AI technologies
- Proficiency in Python or JavaScript/TypeScript plus SQL
- Kubernetes expertise
- Multi-cloud platform experience (AWS, Azure, GCP)
- Strong communication abilities for technical and non-technical audiences
Compensation
Base salary: $179,400 - $224,250 USD
Logistics
- Hybrid: 3 days per week in-office (SF or NY)
Benefits
Comprehensive health, dental, vision coverage, retirement benefits, learning stipend, generous PTO, potential commuter stipend, equity compensation.
