Staff Machine Learning Engineer (Agentic AI/Gen AI)

Zscaler is hiring a Staff Machine Learning Engineer focused on building and maintaining large-scale distributed systems that support the complete machine learning lifecycle — from data collection and processing to real-time model serving and monitoring. Hybrid, based out of the Bangalore office.

Responsibilities

• Develop functional specifications and assess task complexities and timing requirements.
• Build and maintain large-scale distributed systems supporting the complete ML pipeline from data collection through real-time serving.
• Partner with data scientists and product teams to solve complex business problems such as threat detection.
• Debug, optimize, and continuously improve ML systems in production.
• Build infrastructure for ML model training, evaluation, deployment, and monitoring at scale.

Minimum Qualifications

• 5+ years as a Software/ML Engineer.
• Strong programming skills in Python and/or Go/Java.
• Hands-on AWS cloud infrastructure experience (deep expertise required).
• Experience with machine learning model training and serving platforms.
• Strong data structures, algorithms, and system design fundamentals.

Preferred Qualifications

• Familiarity with multi-agent systems, agent architectures, prompt engineering and SOTA AI frameworks.
• Proven experience building Gen AI/ML systems with LLMs, including fine-tuning, Retrieval-Augmented Generation (RAG), and Agentic AI.
• Experience with vector databases, embedding pipelines, and observability stacks for AI workloads.
• Strong understanding of LLM evaluation, prompt engineering, and tool-use patterns.

Privacy inquiries: privacy@zscaler.com