• Built and shipped LLM-based agentic systems in production, not prototypes, including the failure modes: malformed tool output, loops, stuck states, context exhaustion
• Strong and specific opinions about evaluation. This is the part of the job we most need and least have
• Experience with tool and function calling at scale, and with LLM tracing and online evaluation
• Strong systems engineering fundamentals in Python, since agents that touch infrastructure are distributed systems first
• Experience with multi-agent orchestration, handoff, and context management
• Nice to have: operational or SRE background, human-in-the-loop system design, retrieval over operational data, experience defining what an autonomous system is allowed to do