Senior AI / Gen AI Engineer (Applied)

Alterion builds the control plane for the agentic enterprise, enabling organizations to safely deploy, monitor, and scale autonomous AI agents with full visibility and governance. The Intelligence Platform evaluates agent behavior across accuracy, security, cost, and runtime dynamics.

This is an applied engineering position on the Research & Intelligence team. The team builds production systems for understanding and optimizing agent behavior. What ships and what improves in production matters more than research publications.

Key Responsibilities

• Build and maintain production pipelines for model evaluation, scoring, and monitoring
• Apply fine-tuning and lightweight model adaptation techniques
• Develop embeddings, classifiers, and scoring services for natural language analysis
• Run structured experiments evaluating performance and regressions
• Partner with engineering and product teams on system implementation
• Contribute to dashboards and prototypes improving agent visibility

Minimum Requirements

• 5+ years in software engineering, ML engineering, or applied AI
• Strong Python and production service/pipeline experience
• Hands-on LLM work (APIs or open-source models)
• Model evaluation and monitoring familiarity
• ML framework experience (PyTorch or similar)

Preferred Qualifications

• GenAI evaluation, observability, or safety tooling experience
• Knowledge of embeddings, vector search, semantic similarity systems
• Exposure to fine-tuning, PEFT, or cost-aware inference strategies
• Early-stage or fast-moving team experience

Location: San Francisco, CA (On-site) Employment Type: Full-time