Together AI - Senior Software Engineer — Infra Agent Systems UK
Requirements
• 5+ years of experience building production backend systems, distributed systems, or infrastructure platforms. • 5+ years • Strong systems design skills and experience owning significant systems from design through production. • Depth in at least one of the following: • AI agent systems, orchestration, tool use, evaluation, or grounding • Knowledge graphs or graph data modeling • Search, retrieval, ranking, RAG, or semantic search systems • Strong backend engineering experience, including API design, service boundaries, data modeling, and integrations across complex systems. • Experience with Kubernetes, GitOps such as ArgoCD, infrastructure-as-code, and cloud platforms. • Comfortable working across languages such as Go, TypeScript, Python, or Rust. • GPU infrastructure, datacenters, bare-metal systems, hardware failure modes, BMC/IPMI, or cluster schedulers • Graph databases • Event-driven systems and messaging platforms such as NATS or Kafka • Observability platforms such as Prometheus and Grafana • Building evaluation frameworks or improving the quality and reliability of LLM-powered systems • Together AI, the AI Native Cloud, is purpose-built for AI engineers. AI application developers get high-performance inference that scales reliably, fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive scale for fully custom intelligence, all around a marketplace of leading open models that teams can run, adapt, and own. Trusted by Cursor, Decagon, ElevenLabs, Salesforce, and Zoom, Together serves 400+ trillion tokens a month. • Equal Opportunity • Equal Opportunity
Responsibilities
• Design and build production AI agent systems that diagnose, investigate, and remediate infrastructure issues across one of the world’s largest GPU fleets. • Build the distributed services, orchestration framework, knowledge graph, and retrieval systems that power infrastructure agents. • Develop fleet intelligence systems that combine telemetry, infrastructure state, operational knowledge, and historical incidents to help agents make better decisions. • Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems through well-designed APIs. • Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations. • Improve agent performance through evaluations, retrieval improvements, better tools, and production feedback loops. • Turn what agents learn in production into reliable, reviewed software and automation.
Benefits
• You’ll work on two hard problems at the same time: making AI agents trustworthy enough to operate production infrastructure, and building the knowledge, retrieval, and distributed systems that make those agents effective. • You’ll have the opportunity to build foundational systems from the ground up, work on infrastructure at massive scale, and help define how self-improving AI agents operate real-world AI infrastructure. • Remote based in the UK
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT