Senior AI Engineer

Raylu AI
Full-timeSenior
$165K - $230K/yr

AI Tools

Agent OrchestrationEvaluation Frameworks

Tech Stack

PythonTemporal

Agent Workflow

Design, build, and productionize end-to-end agent workflows with APIs, tools, evals, and monitoring. Agentic systems with function calling, multi-step planning, routing, memory, and retrieval.

About the Role

Senior AI Engineer

Company: Raylu AI Location: New York City (Midtown Manhattan, fully in-office, Monday-Friday)

Raylu AI seeks a product-focused Senior AI Engineer experienced in building and deploying LLM-based agent systems. The role emphasizes orchestration, evaluation, and reliability, so agents do real work safely, quickly, and repeatedly. Not a fine-tuning role.

Key Qualifications

  • Agentic systems expertise: function/tool calling, multi-step planning, routing, memory, retrieval
  • Engineering strength: service integration, evaluation frameworks, latency/cost debugging at scale
  • LLM knowledge: model comparison, prompt strategies, guardrail implementation
  • Product orientation: outcome measurement, A/B testing, task success rate optimization
  • Technical depth: principled decision-making on system architecture and code design

Primary Responsibilities

  • Design, build, and productionize end-to-end agent workflows (APIs, tools, evaluation, monitoring)
  • Implement safety controls, cost constraints, latency management; create monitoring dashboards
  • Collaborate with product and design teams on new interaction patterns
  • Document best practices and mentor engineers on LLM-powered feature development

Nice-to-Have

  • Experience with workflow engines (e.g., Temporal)
  • Full-stack engineering capabilities

Compensation

  • Salary: $165,000-$230,000 annually
  • Equity: $100,000-$200,000 equivalent (4-year vesting)

Benefits

  • Comprehensive health, dental, vision insurance
  • 401(k) with 3% automatic contribution (no vesting requirement)
  • Paid lunches
  • Wellness and Citi Bike benefits
  • Unlimited PTO
Apply Now
Apply Now

More jobs like this

Explore related roles

Get jobs like this weekly