Ro (ro.co) - Ro - Senior Engineer, Applied AI
Requirements
• 5+ years building production software, with at least 1–2 years building and deploying LLM-powered applications in production (or equivalent depth through substantial side projects or open-source work). • Strong Python engineer with experience building backend services and integrating modern AI APIs and frameworks. • Comfortable using AI-assisted development tools throughout the software development lifecycle. • You've shipped AI features that served real users, and you can clearly articulate how you measured quality, reliability, latency, cost, and business impact. • You have strong product instincts and thrive in ambiguous environments, translating operational problems into technical solutions without relying on detailed specifications. • Bonus: Experience with orchestration frameworks (LangChain, LangGraph, AgentCore), RAG architectures, vector databases, prompt/version management, and evaluation or observability platforms (e.g., LangSmith, Braintrust, Arize Phoenix). • A note on reporting structure • This is a new function at Ro, and we're being deliberate about not over-defining it. Your manager and where you sit on the org chart will depend on the specific shape of the team we end up with. We'd rather find the right people and figure out the lines around them than pre-draw boxes and miss great candidates. If that ambiguity is a deal-breaker, this isn't the right role; if it sounds like an opportunity, we want to talk. • The target base salary for this position ranges from $182,300 to $220,000, in addition to a competitive equity and benefits package (as applicable). When determining compensation, we analyze and carefully consider several factors, including location, job-related knowledge, skills and experience. These considerations may cause your compensation to vary. • Ro is consistently recognized as a top workplace in Health Care, in New York, and for Women and Parents—earning more than 20 honors from Fortune, Great Place to Work, and PEOPLE since 2021. In 2025 alone, we ranked top 5 among medium workplaces in Health Care and New York, and top 50 nationwide.
Responsibilities
• Design, build, and ship production LLM powered features end-to-end. • Build the AI application layer, including prompt orchestration, tool calling, retrieval (RAG), embeddings, agent workflows, and structured outputs. • Develop evaluation infrastructure, including regression suites, LLM-as-a-judge evaluations, synthetic datasets, human review workflows, and quality metrics that catch regressions before users do. • Design observability systems that measure accuracy, latency, cost, hallucination rates, and model behavior in production. • Build safety and reliability guardrails that ensure AI systems meet quality, compliance, and operational requirements. • Evaluate and integrate third-party tools, including orchestration frameworks, evaluation platforms, vector databases, and model providers; and make pragmatic build-versus-buy decisions. • Raise engineering standards across the team through technical leadership, code reviews, mentorship, and thoughtful system design. • Sit with EHR operators, Patient Advocates, and clinical teams to understand the workflows you're automating. • Prototype quickly, ship early, measure outcomes, and iterate based on real-world usage.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT