Staff Software Engineer, Enterprise GenAI at Scale AI

About Scale AI

Scale GP is an enterprise-grade Generative AI platform that provides APIs for knowledge retrieval, inference, evaluation, and agents. The team seeks a strong engineer for a fast-paced environment involving large-scale distributed systems.

Responsibilities

Own large product areas

Work across backend, frontend, LLM, and ML model integration

Deliver experiments rapidly while maintaining quality

Manage full product lifecycle from conception to production

Multi-task and quickly adopt new technologies

Requirements

7+ years post-graduation engineering experience

Experience scaling products at hyper-growth startups

LLM and vector database experience

Python or JavaScript/TypeScript proficiency

SQL knowledge

Kubernetes experience

Major cloud provider experience (AWS, Azure, GCP)

Compensation

Base salary: $248,400 - $310,500 USD

Logistics

Hybrid: 3 days per week in-office (SF or NY)

Benefits

Base salary plus equity and comprehensive benefits including health coverage, retirement, learning stipend, and PTO.