LLM Platform Engineer
AI Tools
Tech Stack
Agent Workflow
Build and own internal tooling, analytics platforms, and customer-facing applications that power Generative AI team. Cross-functional role across LLM stack (Langchain, Pydantic AI, Langfuse).
About the Role
LLM Platform Engineer at AllSpice
About AllSpice
AllSpice is building the future of hardware development and collaboration, applying modern software design principles to the hardware industry with design review, automated test, and AI (think GitHub + copilot for hardware). AllSpice is unlocking the next generation of smart vehicles, IOT devices, rockets, medical devices, robotics, and much more.
Overview
High-impact role building internal tooling and analytics platforms for AllSpice's Generative AI team at the intersection of engineering, data, and customer experience.
Key Responsibilities
- Collaborate with product and engineering teams on workflow-based tools
- Own evaluation and observability layer for AI products through dashboards and analytics pipelines
- Develop customer-facing applications surfacing AI-powered insights
- Build scripts, data pipelines, and integrations connecting systems, third-party services, LLMs, and MCPs
- Write documentation and communicate technical findings to technical and non-technical audiences
- Champion code quality, testing, and reliability
Example Projects
- Interactive dashboards for AI evaluation
- Customer exploration applications for AI results
- Data pipeline aggregation
- Scripting automation
- RAG-based information repositories
- GitHub Actions CI/CD integration
Required Skills
- 4+ years software engineering experience (tooling, analytics, or full-stack web development)
- Strong SQL and BI platform experience (Jupyter, Metabase, Looker)
- Python scripting for data pipelines
- Web application development (Vue, React, TypeScript)
- LLM frameworks (Langchain) and prompt evaluation expertise
- Excellent communication abilities
- Customer-first mindset
- Bachelor's degree in technology field or equivalent experience
- Project management and stakeholder collaboration
- Comfort with ambiguity and autonomy
Tech Stack: Python, TypeScript/JavaScript, SQL, PostgreSQL, Langchain, Pydantic AI, Langfuse, Vue, GitHub Actions, Docker, Terraform, AWS
Benefits
- Competitive salary and equity
- Health, dental, and vision insurance
- Generous PTO
- Home office stipend
- Flexible work arrangements
Compensation: $160,000 - $190,000