Mistral AI - Research Engineer, Data Infrastructure

• Build & Scale: Help us reach our goal of operating massive distributed compute and storage systems • Global Orchestration: Architect and maintain multi-cluster orchestration layers to optimize workload placement across diverse hardware and regions. • Design Future-Proof Storage: Architect our transition to modern storage formats to handle fine-tuning datasets at a scale that anticipates exabyte growth. • Platform Engineering: Contribute to the development of our internal training platform, ensuring seamless model training and fine-tuning capabilities across Kubernetes and SLURM based environments. • Metadata & Lineage: Implement and manage systems to provide clear visibility and lineage as our data and model pipelines grow in complexity. • Operational Excellence: Use modern deployment workflows to manage cloud-native deployments, ensuring our data platform can scale by orders of magnitude while remaining reliable and efficient. • Have 4+ years of experience in Data Infrastructure, MLOps, or Infrastructure Engineering. • Have experience or a strong interest in supporting foundational compute and storage platforms. • Are proficient in Python and enjoy solving the "brittle data lake" problem with modern, columnar storage standards. • Are well-versed in Kubernetes-native tooling and excited to debug large-scale distributed systems across multi-cluster environments. • Take pride in building and operating scalable, reliable, and secure systems from the ground up. • Are comfortable with ambiguity and the challenges of building high-scale infrastructure in a rapid-growth AI environment.