Software Engineer, Agentic Runtime

Software Engineer, Agentic Runtime

Glean

San Francisco Bay Area (Hybrid - 3-4 days/week in Palo Alto office)

Salary: $170,000 - $265,000

About the Company

Glean is the Work AI platform that helps everyone work smarter with AI. The company evolved from enterprise search into a comprehensive Work AI ecosystem offering intelligent search, AI assistants, and scalable agents on a unified platform. Glean features over 100 enterprise SaaS connectors and maintains flexibility in LLM selection. The platform has been recognized by Fast Company (Top 10 Most Innovative, 2025), CNBC Disruptor 50, and Gartner as a Tech Innovator in Agentic AI.

Role Summary

The Agents Runtime team builds the low-latency, reliable, and secure foundation powering Glean's AI agents. Engineers will design core services for multi-turn orchestration, tool calling, model routing, memory, streaming, and safety mechanisms.

Key Responsibilities

• Own runtime problems end-to-end from architecture through production launch
• Build services for session lifecycle, streaming responses (gRPC/WebSockets), tool execution, and guardrails
• Optimize for performance and cost; reduce latency percentiles and token budgets
• Integrate with LLM providers including OpenAI, Anthropic, and Google Gemini
• Implement fault isolation, retries, timeouts, circuit-breaking, and graceful degradation
• Establish observability through tracing, metrics, and SLO-based playbooks
• Collaborate with product, quality, and application teams

Required Qualifications

• 3+ years building production distributed systems or cloud-native applications
• BS/BA in Computer Science or equivalent experience
• Strong coding in Python, Go, Java, or C++
• Product-minded approach prioritizing customer impact and pragmatic iteration
• Ownership-driven with proactive attitude

Preferred Qualifications

• Kubernetes and major cloud platform experience (GCP, AWS, Azure)
• Event/streaming systems (Pub/Sub, Kafka), caching (Redis), low-latency data stores
• LLM/agent building blocks: tool calling, structured outputs, streaming, model routing
• Observability expertise: OpenTelemetry, metrics, dashboards, forensics
• Experience with policy/guardrails, multi-tenant isolation, rate-limiting, or cost optimization

Benefits

• Medical, Vision, Dental coverage
• Generous time-off policy
• 401(k) plan
• Home office improvement stipend
• Annual education and wellness stipends
• Daily healthy lunches
• Regular company events

Glean emphasizes AI fluency and candidates will complete a brief AI-focused exercise or discussion during interviews. The company commits to inclusive hiring practices.