openloophealth - Senior Engineering Manager, AI Platform
Requirements
• Bachelor's degree in Computer Science, Engineering, or a related technical field • Proven Engineering Experience: 10+ years of software engineering experience, including 3+ years managing engineers directly (hiring, performance management, career development). • Production LLM Experience: Led or built LLM-based systems in production that real users relied on, not only demos, prototypes or personal projects. • Senior Team Leadership: Experience managing senior and Staff-level engineers and earning their technical trust. • Technical Depth: Enough hands-on understanding of agent runtime, evaluation, retrieval and observability to review designs, challenge assumptions and make sound architecture calls. • Evaluation Rigor: You hold teams to measuring whether AI systems work with evaluation data, rather than "it seemed to work." • Engineering Fundamentals: Strong grounding in production engineering across testing, services, APIs, deployment, incident management and on-call. • Data & Security Fluency: Experience leading teams that handle sensitive data with a security-first mindset. • Comfort building in a greenfield space, and clear communication with technical and non-technical partners • Regulated-Industry Experience: Healthcare (PHI, HIPAA), finance or insurance. • GCP Experience: Leading teams that run production services on Google Cloud. • Scaling Teams: Grew an engineering team from zero, or from one team to several. • Model Operations: Led migrations between model versions or providers. • Classic ML Background: Machine learning experience beyond LLMs. • Internal Platforms: Led a platform used by other engineering teams.
Responsibilities
• Build & Lead the Team: Hire, onboard and develop a team of Applied AI Engineers across Senior, Staff and Senior Staff levels, and grow it from a single pod into multiple teams as the work expands. • Own Delivery of Production Agents: Drive the roadmap and execution of LLM-based agents and assistants that real users rely on, from scoping to launch to ongoing operation. • Set the Technical Bar: Partner with Staff+ engineers on architecture for agent runtime and orchestration, retrieval, model access and observability. Make the call on trade-offs when the team needs one. • Evaluation as a Standard: Make evaluation sets, regression tests and AI-graded evals a required part of how the team ships, so we can show improvement with numbers and catch regressions before users do. • Reliability, Cost & Operations: Own the operational health of AI systems in production, including on-call, incident response, provider fallbacks, model version upgrades and AI spend by agent and use case. • Security, Privacy & Safety: Make sure every AI system protects patient data (PHI), follows least-privilege access, and defends against misuse such as prompt injection. Partner with Security and Compliance on HIPAA requirements. • Workflow & Use Case Prioritization: Work with Product and Operations leaders to find where agents can reliably take over human workflows, where they should hand off to a person, and which bets to make first. • Cross-functional Leadership: Explain AI capabilities, risks and timelines in plain language to product, operations, clinical and executive stakeholders, including when the honest answer is "the AI isn't ready for this yet." • Team Health & Process: Run planning, prioritization and delivery rituals that keep a senior team shipping fast without burning out. Give clear, direct feedback and build career paths.
Benefits
• In addition to a competitive base pay, for salaried positions you would also be eligible for: • Medical, Dental, and Vision plans • Flexible Spending/Health Savings Accounts • 401(k) + Company Match • Life Insurance, Pet insurance, and more • We have a relatively flat organizational structure here at OpenLoop. Everyone is encouraged to bring ideas to the table and make things happen. This fits in well with our core values of Autonomy, Competence and Belonging, as we want everyone to feel empowered and supported to do their best work. • Sound like a good fit? We’d love to meet you.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT