- Jobs
- Clarity AI
- Senior Staff GenAI Platform Engineer
Senior Staff GenAI Platform Engineer
Full-timeStaff
AI Tools
CrewAIDeepEvalLangChainLlamaIndexRagasTGIvLLM
Tech Stack
PythonKubernetesDockerAWSGCPLangChainLlamaIndexCrewAIvLLMVector DatabasesGitOpsRAG
Agent Workflow
Building specialized infrastructure to support long-running agentic workflows including state management, tool-calling interfaces, and complex reasoning loops. Platform for deployment and scaling of LLMs and multi-agent systems.
About the Role
Clarity AI is looking for a Senior Staff GenAI Platform Engineer (titled "Senior MLE Staff Engineer" on live posting) who is an expert in the deployment and scaling of LLMs and Agentic systems, based in Madrid.
Key Responsibilities
- GenAI Platform Engineering: Designing and developing the core platform that enables the efficient deployment, scaling, and management of LLMs and multi-agent systems
- Infrastructure for Agents: Building specialized infrastructure to support long-running agentic workflows, including state management, tool-calling interfaces, and complex reasoning loops
- Model Serving: Scaling inference to handle global demand while optimizing for latency, throughput, and cost
- Golden Path: Establishing self-service path to move code, data, and models to production safely with automated evaluation and CI/CD/CT pipelines
- End-to-End Observability: Implementing unified visibility into health, impact, and root cause across data, ML, and GenAI (including model hallucinations, token usage, and RAG performance)
- Platform Product Management: Evolving the platform to maintain competitive advantage
Required Skills
- 3+ years MLOps/AI production engineering experience
- Expert Python, Kubernetes, Docker, AWS/GCP
- Prompt lifecycle management, LLM abstraction layers, cost controls
- Evaluation frameworks (Ragas, DeepEval, G-Eval), LLM-as-a-judge patterns
- Orchestration: LangChain, LlamaIndex, CrewAI
- Vector databases, inference engines (vLLM, TGI)
- Model registry, monitoring, drift detection
- API design, microservices, GitOps
- C1+ English proficiency
Location: Madrid, Spain (hybrid, CET +/- 2h remote-friendly)