cantina - Research Scientist, Real-Time Video Generation

• WHAT YOU’LL WORK ON • Real-time and streaming generation. Develop models that support responsive interaction while maintaining visual quality and consistency over time. Investigate latency, continuity, and how model behavior changes during longer generation. • Character expression and motion. Explore how appearance, facial expression, gesture, and body movement come together into a coherent character. Improve the relationship between speech and motion across different identities and visual styles. • Fine-tuning and post-training. Adapt video models to new data, behaviors, and capabilities. Investigate training objectives and conditioning methods, and follow promising ideas through implementation and evaluation. • Distillation and inference optimization. Make generation faster and more efficient. Work across model-level approaches and runtime improvements, measuring their effects on quality, latency, and memory. • Data development. Spend meaningful time with the actual training examples. Identify missing coverage and recurring failure modes, improve curation and sampling, and develop data that helps models learn the behavior we want. • Evaluation. Build comparisons that make progress visible and failures understandable. Combine quantitative measurements with careful inspection of generated video and the experience of interacting with the model. • Research and collaboration. Read relevant work, reproduce and adapt useful ideas, and share early experiments, demos, and findings. Help the team decide what deserves more time and compute. • Experience training or fine-tuning video or related generative models. • Ability to learn unfamiliar methods quickly and turn ideas into useful experiments. • Good experimental judgment, ownership, and clear communication. • You’ll have freedom to explore new approaches. We expect fast iteration and early sharing of results.