AI/ML Engineer – LLM Systems (m/f/d) at Anexia Internetdienstleistungs GmbH

Anexia is hiring an AI/ML Engineer for LLM Systems to drive the development and deployment of AI/ML systems, with a particular focus on Large Language Models (LLMs) and intelligent agent frameworks.

Key Responsibilities

Implement and operate LLM inference solutions with runtimes such as Ollama, vLLM, and TensorRT-LLM

Develop agentic applications with frameworks such as Dify, LangFlow, Haystack, LlamaIndex, LangChain, LangGraph, or Pydantic AI

Integrate AI capabilities from various providers (OpenAI, Anthropic, Groq, Cerebras) into production systems

Implement LLMOps practices using tools like LangFuse and LangSmith for monitoring, tracing, and observability

Build and optimize ML pipelines using Python, TensorFlow, PyTorch, and scikit-learn

Containerize and deploy AI applications using Docker and Podman

Work with SQL databases and implement evaluation frameworks like DeepEval

Required Qualifications

Hands-on experience with at least one agentic framework (LangChain, LangGraph, Haystack, LlamaIndex, Dify, LangFlow, or Pydantic AI)

Experience with Python and modern ML frameworks (TensorFlow, PyTorch, scikit-learn)

Proficiency with LLM inference runtimes (Ollama, vLLM, TensorRT-LLM)

Experience with LLM APIs (OpenAI, Anthropic, or similar)

Containerization (Docker/Podman) and orchestration tools

Very good German and English language skills

Valued Skills: Experience with RAG, prompt engineering, or multi-agent systems.

Salary: Starting from approximately EUR 63,000/year.

Benefits: Flexible working hours, further training, mentoring program, company car, employee events.

Location: Headquartered in Klagenfurt, Austria with offices in Vienna, Graz, Karlsruhe, Nuremberg, and New York. Remote work possible within Austria/DACH region.