AI/ML Engineer – LLM Systems (m/f/d)

Anexia is hiring an AI/ML Engineer for LLM Systems to drive the development and deployment of AI/ML systems, with a particular focus on Large Language Models (LLMs) and intelligent agent frameworks.

Key Responsibilities

• Implement and operate LLM inference solutions with runtimes such as Ollama, vLLM, and TensorRT-LLM
• Develop agentic applications with frameworks such as Dify, LangFlow, Haystack, LlamaIndex, LangChain, LangGraph, or Pydantic AI
• Integrate AI capabilities from various providers (OpenAI, Anthropic, Groq, Cerebras) into production systems
• Implement LLMOps practices using tools like LangFuse and LangSmith for monitoring, tracing, and observability
• Build and optimize ML pipelines using Python, TensorFlow, PyTorch, and scikit-learn
• Containerize and deploy AI applications using Docker and Podman
• Work with SQL databases and implement evaluation frameworks like DeepEval

Required Qualifications

• Hands-on experience with at least one agentic framework (LangChain, LangGraph, Haystack, LlamaIndex, Dify, LangFlow, or Pydantic AI)
• Experience with Python and modern ML frameworks (TensorFlow, PyTorch, scikit-learn)
• Proficiency with LLM inference runtimes (Ollama, vLLM, TensorRT-LLM)
• Experience with LLM APIs (OpenAI, Anthropic, or similar)
• Containerization (Docker/Podman) and orchestration tools
• Very good German and English language skills

Valued Skills: Experience with RAG, prompt engineering, or multi-agent systems.

Salary: Starting from approximately EUR 63,000/year.

Benefits: Flexible working hours, further training, mentoring program, company car, employee events.

Location: Headquartered in Klagenfurt, Austria with offices in Vienna, Graz, Karlsruhe, Nuremberg, and New York. Remote work possible within Austria/DACH region.