cantina - Machine Learning Engineer, Ops
Requirements
• Deep understanding of modern audio model architectures (e.g., TTS, ASR) and their specific inference requirements. • Strong hands-on experience with Kubernetes (K8S), container orchestration, and implementing autoscaling strategies for production workloads. • Solid background in MLOps, including CI/CD automation and managing scalable cloud infrastructure. • Proficiency in software engineering principles and experience with Python or Go for infrastructure tooling and backend services. • Experience with GPU-accelerated inference and performance profiling techniques. • Familiarity with high-performance inference engines (e.g., Triton Inference Server, vLLM-Omni) is a plus.
Responsibilities
• Design and maintain inference infrastructure for generative audio model architectures. • Implement and manage high-performance inference engines. • Orchestrate service deployments using Kubernetes (K8S), implementing advanced autoscaling paradigms to handle varying traffic loads efficiently. • Develop and automate robust CI/CD pipelines to streamline the testing and deployment of model artifacts and inference configurations. • Monitor production systems, establishing observability practices to track latency, resource utilization, and overall model performance. • Collaborate closely with research teams to optimize model serving paths and evaluate various inference strategies. • Optimize inference performance for both streaming and batch applications.
Benefits
• The anticipated annual base salary range for this role is between $125,000-$165,000 (€110,000-€145,000). When determining compensation, a number of factors will be considered, including skills, experience, job scope, location, and competitive compensation market data. • Competitive salary and generous company equity • Medical, dental, and vision insurance – 99.99% of premiums covered by Cantina • 42 days of paid time off, including: • 15 company holidays • 2 floating holidays • Generous parental leave & fertility support • 401(k) retirement savings plan • Lifestyle spending account – $500/month to use however you’d like • Complimentary lunch and snacks for in-office employees • One Medical membership, and more!
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT