LLM Platform Engineer

LLM Platform Engineer at AllSpice

About AllSpice

AllSpice is building the future of hardware development and collaboration, applying modern software design principles to the hardware industry with design review, automated test, and AI (think GitHub + copilot for hardware). AllSpice is unlocking the next generation of smart vehicles, IOT devices, rockets, medical devices, robotics, and much more.

Overview

High-impact role building internal tooling and analytics platforms for AllSpice's Generative AI team at the intersection of engineering, data, and customer experience.

Key Responsibilities

• Collaborate with product and engineering teams on workflow-based tools
• Own evaluation and observability layer for AI products through dashboards and analytics pipelines
• Develop customer-facing applications surfacing AI-powered insights
• Build scripts, data pipelines, and integrations connecting systems, third-party services, LLMs, and MCPs
• Write documentation and communicate technical findings to technical and non-technical audiences
• Champion code quality, testing, and reliability

Example Projects

• Interactive dashboards for AI evaluation
• Customer exploration applications for AI results
• Data pipeline aggregation
• Scripting automation
• RAG-based information repositories
• GitHub Actions CI/CD integration

Required Skills

• 4+ years software engineering experience (tooling, analytics, or full-stack web development)
• Strong SQL and BI platform experience (Jupyter, Metabase, Looker)
• Python scripting for data pipelines
• Web application development (Vue, React, TypeScript)
• LLM frameworks (Langchain) and prompt evaluation expertise
• Excellent communication abilities
• Customer-first mindset
• Bachelor's degree in technology field or equivalent experience
• Project management and stakeholder collaboration
• Comfort with ambiguity and autonomy

Tech Stack: Python, TypeScript/JavaScript, SQL, PostgreSQL, Langchain, Pydantic AI, Langfuse, Vue, GitHub Actions, Docker, Terraform, AWS

Benefits

• Competitive salary and equity
• Health, dental, and vision insurance
• Generous PTO
• Home office stipend
• Flexible work arrangements

Compensation: $160,000 - $190,000