• An LLM gateway or proxy (LiteLLM or similar) in production.
• LLM observability tooling: Datadog LLM Observability, LangSmith, Braintrust, Arize, or similar.
• Eval frameworks and LLM-as-judge scoring in a real workflow, not a demo.
• FinOps instincts — cost attribution, showback, quota design.
• Guardrails, PII detection, or content-filtering systems.
• GCP alongside AWS.
• Our stack
• AWS - GCP · EKS, Flux/GitOps, Karpenter · Python · LiteLLM · Datadog (LLM observability, APM) · Prometheus, Loki, ClickHouse · Terraform · GitLab CI