drata - Staff AI Software Engineer
Requirements
• 10+ years of software engineering experience, including 3+ years working directly on ML/AI systems. • Real ownership of production LLM systems. • Deep experience with RAG, embeddings, reranking, vector databases (Pinecone, FAISS, Chroma, etc.), and agentic workflows. • Experience designing evaluation frameworks and using quantitative analysis to improve system performance. • Strong Python skills (TypeScript is a plus). • A track record of making architectural decisions that shape team direction. • Experience operating AI systems in production - observability, reliability, cost tradeoffs. • The ability to break down ambiguous, high-stakes problems into structured investigations. • Clear communication skills and comfort working cross-functionally. • Experience in compliance, security, or other regulated domains. • Familiarity with enterprise data platforms or Snowflake-based analytics. • Experience with orchestration systems like Temporal or Airflow. • Experience building or using LLM evaluation platforms (e.g., Braintrust). • Contributions to technical communities or published work.
Responsibilities
• SHAPE THE ARCHITECTURE • Design and own production AI systems end-to-end (LLM pipelines, RAG, reranking, vector stores, orchestration). • Make thoughtful build/don’t-build decisions based on real data. • Evolve our AI stack over time, from model infrastructure to workflow orchestration to evaluation tooling. • RAISE THE QUALITY BAR • Design evaluation systems that measure retrieval quality, reasoning accuracy, end-to-end performance. • Build tooling that helps the team iterate confidently and catch regressions early. • Define how we measure success across the platform. • INVESTIGATE DEEPLY & DECIDE WITH EVIDENCE • Analyze production outputs to identify failure patterns and root causes. • Turn complex findings into clear technical recommendations. • Know when to push forward and when to pause based on data. • LEAD ACROSS TEAMS • Be the go-to technical voice for AI architecture decisions. • Influence standards for how LLM systems are built, tested, deployed, and monitored. • Mentor senior engineers through design reviews and hands-on collaboration. • Partner with product and compliance teams to translate domain complexity into clean technical solutions. • BUILD RESPONSIBLE, PRODUCTION-READY AI • Ship systems optimized for latency, cost, reliability, and auditability. • Embed safety guardrails, confidence thresholds, and human-in-the-loop workflows. • Ensure outputs are traceable and explainable.
Benefits
• The best way to understand the Driver’s Mindset is to see it in action. We’re an award-winning, mission-driven team of 600+ people worldwide, united by a culture that values trust, speed, and continuous growth. • See the Speed: https://www.youtube.com/watch?v=QidTdkGwKMY Watch our CEO, Adam Markowitz, discuss the hyper-growth journey, from $0 to $100M ARR in just four years • Hear the Voice of the Team https://drata.com/about/life-at-drata: Explore our "Life at Drata" page for employee testimonials on our collaborative and the growth opportunities available. • Experience the Impact https://www.greatplacetowork.com/certified-company/7044563: See why we are consistently recognized on Fortune's Best Workplaces lists. • Connect with Us on Socials: LinkedIn https://www.linkedin.com/company/drata/posts/?feedView=all - follow us for company updates, employee stories, and career news. • While we’re ideally looking for someone who can join us in a hybrid capacity from our San Francisco office, we know great talent isn’t limited by zip code. We’ll consider remote candidates across the U.S. who are a strong match for the role. • You won’t just ship features - you’ll help define how AI is built at Drata. • Your work will: • Set the architectural foundation for our AI systems. • Establish the quality bar that lets us move fast with confidence. • Ensure our technical investments are grounded in evidence. • Raise the technical bar across the AI organization. • How we support you: • At Drata, our people are our strongest advantage—and we prove it with support that exceeds industry standards. Our total rewards package is designed to power your well-being, accelerate your growth, and keep your work-life balance thriving. • Explore how we invest in your Life at Drata https://drata.com/about/life-at-drata?utm_source=chatgpt.com.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT