lumaai - Software Engineer, Inference

• Strong Python and system-architecture skills. • Experience deploying models with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or similar. • Experience with queues, scheduling, traffic control, and fleet management at scale. • Experience with Linux, Docker, and Kubernetes, and with orchestration, deployment, and scheduling. • Familiarity with Redis and S3-compatible storage. • Modern networking stacks including RDMA (RoCE, InfiniBand, NVLink). • High-performance large-scale ML systems (100+ GPUs). • CUDA, and FFmpeg or multimedia processing.