Software Engineer, Agentic Runtime at Glean

Software Engineer, Agentic Runtime

Glean

San Francisco Bay Area (Hybrid - 3-4 days/week in Palo Alto office)

Salary: $170,000 - $265,000

About the Company

Glean is the Work AI platform that helps everyone work smarter with AI. The company evolved from enterprise search into a comprehensive Work AI ecosystem offering intelligent search, AI assistants, and scalable agents on a unified platform. Glean features over 100 enterprise SaaS connectors and maintains flexibility in LLM selection. The platform has been recognized by Fast Company (Top 10 Most Innovative, 2025), CNBC Disruptor 50, and Gartner as a Tech Innovator in Agentic AI.

Role Summary

The Agents Runtime team builds the low-latency, reliable, and secure foundation powering Glean's AI agents. Engineers will design core services for multi-turn orchestration, tool calling, model routing, memory, streaming, and safety mechanisms.

Key Responsibilities

Own runtime problems end-to-end from architecture through production launch

Build services for session lifecycle, streaming responses (gRPC/WebSockets), tool execution, and guardrails

Optimize for performance and cost; reduce latency percentiles and token budgets

Integrate with LLM providers including OpenAI, Anthropic, and Google Gemini

Implement fault isolation, retries, timeouts, circuit-breaking, and graceful degradation

Establish observability through tracing, metrics, and SLO-based playbooks

Collaborate with product, quality, and application teams

Required Qualifications

3+ years building production distributed systems or cloud-native applications

BS/BA in Computer Science or equivalent experience

Strong coding in Python, Go, Java, or C++

Product-minded approach prioritizing customer impact and pragmatic iteration

Ownership-driven with proactive attitude

Preferred Qualifications

Kubernetes and major cloud platform experience (GCP, AWS, Azure)

Event/streaming systems (Pub/Sub, Kafka), caching (Redis), low-latency data stores

LLM/agent building blocks: tool calling, structured outputs, streaming, model routing

Observability expertise: OpenTelemetry, metrics, dashboards, forensics

Experience with policy/guardrails, multi-tenant isolation, rate-limiting, or cost optimization

Benefits

Medical, Vision, Dental coverage

Generous time-off policy

401(k) plan

Home office improvement stipend

Annual education and wellness stipends

Daily healthy lunches

Regular company events

Glean emphasizes AI fluency and candidates will complete a brief AI-focused exercise or discussion during interviews. The company commits to inclusive hiring practices.