AI Platform Engineer

About the Role

OpenVPN is hiring an AI Platform Engineer to build the company's AI platform from scratch on GCP (Vertex AI). You will establish AI/ML infrastructure, governance frameworks, and operational tooling that supports internal teams running RAG pipelines, agents, and automation workflows.

Responsibilities

AI Developer Tooling and Enablement

• Manage rollout of AI-assisted tools (Cursor, Copilot, Claude Code) across engineering
• Implement access controls, licensing, and usage policies meeting SOC2/ISO 27001 standards
• Build cost tracking and reporting for leadership visibility

Internal AI-Powered Workflows

• Partner with teams to identify and build internal AI applications such as RAG pipelines, agents, and automation workflows
• Evaluate tooling and define platform boundaries

Governance, Security and Compliance

• Advise on data governance for LLM usage and audit trails
• Ensure infrastructure meets SOC2/ISO 27001 compliance
• Provide leadership reporting on adoption, cost, and risk

AI/ML Cloud Infrastructure

• Stand up and manage AI/ML infrastructure on GCP Vertex AI
• Design Terraform modules following GitOps patterns (Atlantis-driven)
• Operationalize LLM patterns: prompt caching, batching strategies, model versioning, and inference cost controls

Cost Management

• Build visibility into infrastructure costs; implement spot instances and auto-scaling controls

Requirements

• Hands-on experience with Vertex AI or comparable platforms (SageMaker, Azure ML)
• Experience setting up AI developer tooling at organizational level
• Terraform fluency with Atlantis workflow
• Cross-team collaboration ability
• Clear communication with leadership on cost/risk/value

Strong Preferences

• GCP expertise
• SOC2/ISO 27001 compliance experience
• Platform engineering mindset
• Model serving infrastructure experience (Vertex AI endpoints, Bedrock, Azure OpenAI)
• RAG infrastructure knowledge (vector databases, embeddings, retrieval systems)
• LLM operational patterns (prompt caching, batching, monitoring)

Nice to Have

• Kubernetes/EKS familiarity
• BigQuery, Kafka, Cloud Composer experience
• Ansible/Puppet knowledge
• AWS AI/ML services (Bedrock, SageMaker)
• Greenfield buildout experience

Location

Remote (US only). Available in CA, AZ, CO, FL, MD, MI, MN, NV, NJ, NY, OH, OR, TX, UT, WA, VA, IN, and others.

Compensation

$140,000 - $150,000 base.