Senior Software Engineer, Agentic Platform
Upload My Resume
Drop here or click to browse · PDF, DOCX, DOC, RTF, TXT
Requirements
• You're a platform engineer at heart—someone who understands that the best infrastructure is invisible to its users while handling enormous complexity under the hood. You have a track record of designing systems that other engineers love to use, and you know how to balance powerful abstractions with practical simplicity. • You understand that LLM systems present unique challenges: non-deterministic outputs, rapidly evolving provider SDKs, safety requirements, and the need for systematic quality measurement. You're excited to tackle "churn containment"—building stable APIs that absorb the chaos of monthly model releases and quarterly SDK updates. • 4+ years of software engineering experience with significant time spent building platform infrastructure, developer tools, SDKs, or distributed Systems • Production experience with LLM/AI systems—you've built and operated systems using OpenAI, Anthropic, or similar providers, and understand the unique challenges (token limits, non-determinism, provider outages, model deprecations) • Strong TypeScript expertise—this is our company standard, and you'll be designing APIs that other TypeScript developers consume • Experience designing APIs and abstractions that other engineers love to use—you understand the balance between power and simplicity • Understanding of safety and compliance in AI systems—PII handling, guardrails, audit logging, and responsible AI practices • Experience with event-driven architectures and async processing patterns (EventBridge, SQS, or similar) • Understanding of observability and monitoring for distributed systems—metrics, tracing, alerting, and debugging production issues • Strong communication and technical writing skills—ability to document systems clearly and work with internal customers across multiple teams • Track record of technical leadership without or without formal management—influencing architecture, mentoring engineers, and driving technical decisions • Experience with cloud infrastructure (AWS preferred: Fargate, DynamoDB, RDS, S3, EventBridge) • Experience building SDK or platform products consumed by multiple teams • Experience with prompt engineering, prompt management systems, or LLM evaluation frameworks • Familiarity with NestJS, Prisma, or similar TypeScript backend frameworks • Experience with streaming architectures (SSE, WebSockets) for real-time AI applications • Background in building multi-tenant platform infrastructure • Experience with hexagonal architecture / ports and adapters patterns • Contributions to open-source LLM tooling or frameworks • TECHNICAL ENVIRONMENT • Languages: TypeScript (primary) • Frameworks: NestJS, OpenAI Agents SDK, Vercel AI SDK • Databases: PostgreSQL (Prisma ORM), DynamoDB, Redis • Infrastructure: AWS (Fargate, EventBridge, S3, Parameter Store), Docker • Observability: Langfuse, NewRelic, Coval • Testing: Vitest • CI/CD: GitHub Actions, SonarQube • LLM Providers: OpenAI, Anthropic (with architecture for additional providers) • Coding Agents: Claude, Codex, Gemini
Responsibilities
• Design and build core platform primitives including provider abstraction layers (OpenAI, Anthropic, Google), structured output validation, streaming infrastructure, and token management systems • Own safety and compliance infrastructure including composable guardrail systems, PII detection/redaction, audit logging, and privacy-first observability that never leaks sensitive data to third parties • Build evaluation infrastructure that enables systematic quality measurement for non-deterministic LLM outputs—datasets, scorers (exact match, LLM-as-judge, schema validation), CI/CD integration, and regression detection • Lead churn containment strategy—design provider adapters and SDK architecture that absorbs rapidly-changing LLM provider SDKs without breaking consuming applications • Architect prompt lifecycle management systems including version control, Langfuse integration, GitHub-based review workflows, and deployment pipelines • Design Agent-as-a-Service infrastructure for long-running async tasks using AWS EventBridge, DynamoDB, and PostgreSQL • Collaborate with consuming teams to understand their needs, onboard them to the platform, and provide technical support • Influence architecture, technology selections, and engineering standards across the broader organization • Create reference implementations and technical documentation that enables other engineers to successfully adopt the platform • Champion quality engineering practices including comprehensive testing, type safety, and observability
Benefits
• Base Salary Range: $130K – $160K • Offers Bonus • Bonus: 10% of Annual Earnings • Upload your resume here to autofill key application fields. • Drop your resume here! • Parsing your resume. Autofilling key fields... • or drag and drop here • Decline to self-identify • Hispanic or Latino - A person of Cuban, Mexican, Puerto Rican, South or Central American, or other Spanish culture or origin regardless of race. • Hispanic or Latino • White (Not Hispanic or Latino) - A person having origins in any of the original peoples of Europe, the Middle East, or North Africa. • White • Black or African American (Not Hispanic or Latino) - A person having origins in any of the black racial groups of Africa. • Black or African American • Native Hawaiian or Other Pacific Islander (Not Hispanic or Latino) - A person having origins in any of the peoples of Hawaii, Guam, Samoa, or other Pacific Islands. • Native Hawaiian or Other Pacific Islander • Asian (Not Hispanic or Latino) - A person having origins in any of the original peoples of the Far East, Southeast Asia, or the Indian Subcontinent, including, for example, Cambodia, China, India, Japan, Korea, Malaysia, Pakistan, the Philippine Islands, Thailand, and Vietnam. • Asian • American Indian or Alaska Native (Not Hispanic or Latino) - A person having origins in any of the original peoples of North and South America (including Central America), and who maintain tribal affiliation or community attachment. • American Indian or Alaska Native • Two or More Races (Not Hispanic or Latino) - All persons who identify with more than one of the above five races. • Two or More Races • Hispanic or Latino • White (Not Hispanic or Latino) • Black or African American (Not Hispanic or Latino) • Native Hawaiian or Other Pacific Islander (Not Hispanic or Latino) • Asian (Not Hispanic or Latino) • American Indian or Alaska Native (Not Hispanic or Latino) • Two or More Races (Not Hispanic or Latino) • I identify as one or more of the classifications of protected veteran listed above • I am not a protected veteran