Senior AI / Gen AI Engineer (Applied) at Alterion

Alterion builds the control plane for the agentic enterprise, enabling organizations to safely deploy, monitor, and scale autonomous AI agents with full visibility and governance. The Intelligence Platform evaluates agent behavior across accuracy, security, cost, and runtime dynamics.

This is an applied engineering position on the Research & Intelligence team. The team builds production systems for understanding and optimizing agent behavior. What ships and what improves in production matters more than research publications.

Key Responsibilities

Build and maintain production pipelines for model evaluation, scoring, and monitoring

Apply fine-tuning and lightweight model adaptation techniques

Develop embeddings, classifiers, and scoring services for natural language analysis

Run structured experiments evaluating performance and regressions

Partner with engineering and product teams on system implementation

Contribute to dashboards and prototypes improving agent visibility

Minimum Requirements

5+ years in software engineering, ML engineering, or applied AI

Strong Python and production service/pipeline experience

Hands-on LLM work (APIs or open-source models)

Model evaluation and monitoring familiarity

ML framework experience (PyTorch or similar)

Preferred Qualifications

GenAI evaluation, observability, or safety tooling experience

Knowledge of embeddings, vector search, semantic similarity systems

Exposure to fine-tuning, PEFT, or cost-aware inference strategies

Early-stage or fast-moving team experience

Location: San Francisco, CA (On-site) Employment Type: Full-time