Veeam Software - Staff AI Engineer
Requirements
• Proven experience integrating AI/ML services and APIs into production backend systems, including APIs, async pipelines, and cloud infrastructure, treating models and inference endpoints as components in a larger service architecture • Hands-on experience shipping LLM-powered capabilities end to end, such as embeddings pipelines, RAG, summarization, or LLM-powered assistants, with a strong understanding of failure modes • Experience designing and operating multi-step agentic workflows with real tool use, including strategies for reliability, observability, and recovery • Working knowledge of Model Context Protocol (MCP), including building MCP servers, designing tool exposure contracts, or integrating MCP into agent workflows • Experience with prompt engineering and evaluation including structured outputs, hallucination reduction, evals frameworks, and LLM observability tooling • Experience building multi-tenant systems with data boundary enforcement, tenant-aware access controls, and LLM safety guardrails • Familiarity with authentication and authorization patterns including OAuth 2.0, OIDC, JWT, and API key management in cloud backend systems • Experience integrating with enterprise identity providers such as Azure AD / Entra ID or Okta • Familiarity with AI governance concepts including data access policies, audit trails, or agent guardrail frameworks • Background working with heterogeneous, multilingual, or large-scale enterprise data environments • Experience with adversarial prompt hardening and OWASP LLM Top 10 security patterns • What you'll get • What you'll get • Unlimited paid time off, 12 paid holidays including 4 global VeeaMe Days for self-care and 24 paid volunteer hours annually through Veeam Cares • Paid parental leave: 8 weeks for all parents, 16 weeks for birthing parents • Medical, dental, and vision coverage starting on your first day • Mental health support, therapy sessions, and digital wellness tools via our Employee Assistance Program • 401(k) retirement plan with company matching contributions • Fertility, adoption, and surrogacy support through Maven, plus paid volunteer time • AirVet: 24/7 virtual veterinary care at no cost • Legal services, identity protection, and supplemental health insurance options • Tax-advantaged spending accounts for healthcare, dependent care, and commuting • Opportunities to learn and grow through on-demand libraries (LinkedIn Learning, O’Reilly), mentoring, workshops, and learning events like our annual Global Day of Learning
Responsibilities
• Lead agentic AI development, including multi-agent orchestration patterns, agent-to-agent protocols, and reliable tool use at production scale • Own prompt engineering and evaluation workflows including structured outputs, hallucination reduction, and behavioral consistency • Build and own MCP server infrastructure that exposes backup data to AI agents via the Model Context Protocol, enforcing tenant-aware RBAC, query constraints, and safe tool boundaries • Define AI quality benchmarks for retrieval relevance, summarization accuracy, and agent reliability, and drive systematic improvements through eval-driven iteration • Champion security and safety in AI systems, including adversarial prompt hardening, jailbreak resistance, data boundary enforcement, and OWASP LLM Top 10 awareness • Tune AI workflows for performance, cost, latency, and observability across billions of documents in global regions • Mentor engineers on the team, raise the technical bar, and contribute to architecture reviews and design decisions • Technologies You’ll Work With • Azure OpenAI Service, Kubernetes, Cosmos DB, Blob Storage, Event Bus, Model Context Protocol (MCP), OAuth 2.0, OIDC, Azure AD / Entra ID
Benefits
• In addition to compensation, Veeam provides a comprehensive benefits package, including health coverage, retirement plans, and unlimited time off. • Zone 1: San Francisco Bay Area, New York City Boroughs • $366,300—$680,200 USD • Zone 2: Washington, California (excluding San Francisco Bay Area) • $335,800—$623,500 USD • Zone 3: Texas, Illinois, North Carolina, Colorado, Massachusetts, Pennsylvania, Virginia, Oregon, Nevada, Hawaii, New York (excluding NYC boroughs); Sales roles located in Georgia, Ohio, and Arizona • $305,200—$566,800 USD • Zone 4: All other US locations • $265,600—$493,100 USD
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT