Anexia is hiring an AI/ML Engineer for LLM Systems to drive the development and deployment of AI/ML systems, with a particular focus on Large Language Models (LLMs) and intelligent agent frameworks.

Key Responsibilities

Implement and operate LLM inference solutions with runtimes such as Ollama, vLLM, and TensorRT-LLM
Develop agentic applications with frameworks such as Dify, LangFlow, Haystack, LlamaIndex, LangChain, LangGraph, or Pydantic AI
Integrate AI capabilities from various providers (OpenAI, Anthropic, Groq, Cerebras) into production systems
Implement LLMOps practices using tools like LangFuse and LangSmith for monitoring, tracing, and observability
Build and optimize ML pipelines using Python, TensorFlow, PyTorch, and scikit-learn
Containerize and deploy AI applications using Docker and Podman
Work with SQL databases and implement evaluation frameworks like DeepEval

Required Qualifications

Hands-on experience with at least one agentic framework (LangChain, LangGraph, Haystack, LlamaIndex, Dify, LangFlow, or Pydantic AI)
Experience with Python and modern ML frameworks (TensorFlow, PyTorch, scikit-learn)
Proficiency with LLM inference runtimes (Ollama, vLLM, TensorRT-LLM)
Experience with LLM APIs (OpenAI, Anthropic, or similar)
Containerization (Docker/Podman) and orchestration tools
Very good German and English language skills

Valued Skills: Experience with RAG, prompt engineering, or multi-agent systems.

Salary: Starting from approximately EUR 63,000/year.

Benefits: Flexible working hours, further training, mentoring program, company car, employee events.

Location: Headquartered in Klagenfurt, Austria with offices in Vienna, Graz, Karlsruhe, Nuremberg, and New York. Remote work possible within Austria/DACH region.

Mid Haystack Developer Jobs

Get jobs like these weekly