Senior AI Engineer at Raylu AI

Senior AI Engineer

Company: Raylu AI Location: New York City (Midtown Manhattan, fully in-office, Monday-Friday)

Raylu AI seeks a product-focused Senior AI Engineer experienced in building and deploying LLM-based agent systems. The role emphasizes orchestration, evaluation, and reliability, so agents do real work safely, quickly, and repeatedly. Not a fine-tuning role.

Key Qualifications

Agentic systems expertise: function/tool calling, multi-step planning, routing, memory, retrieval

Engineering strength: service integration, evaluation frameworks, latency/cost debugging at scale

LLM knowledge: model comparison, prompt strategies, guardrail implementation

Product orientation: outcome measurement, A/B testing, task success rate optimization

Technical depth: principled decision-making on system architecture and code design

Primary Responsibilities

Design, build, and productionize end-to-end agent workflows (APIs, tools, evaluation, monitoring)

Implement safety controls, cost constraints, latency management; create monitoring dashboards

Collaborate with product and design teams on new interaction patterns

Document best practices and mentor engineers on LLM-powered feature development

Nice-to-Have

Experience with workflow engines (e.g., Temporal)

Full-stack engineering capabilities

Compensation

Salary: $165,000-$230,000 annually

Equity: $100,000-$200,000 equivalent (4-year vesting)

Benefits

Comprehensive health, dental, vision insurance

401(k) with 3% automatic contribution (no vesting requirement)

Paid lunches

Wellness and Citi Bike benefits

Unlimited PTO