Prime Intellect - Research Engineer

San Francisco, California, United States1mo ago

In Office NA Artificial Intelligence Research Engineer MLOps

Requirements

• Strong background in AI/ML engineering, with extensive experience in designing and implementing end-to-end pipelines for the inference or training of large-scale AI models. • Deep expertise in distributed inference techniques and frameworks (e.g. vllm, sglang) for optimizing the performance and scalability of AI workloads. • Solid understanding of MLOps best practices, including model versioning, experiment tracking, and continuous integration/deployment (CI/CD) pipelines. • Passion for advancing the state-of-the-art in reasoning and democratizing access to AI capabilities for researchers, developers, and businesses worldwide. • If you're not familiar with these, but feel like that you can contribute to our mission and you're a high-energy person, get familiar with these resources (here, here and here) and please reach out!

Responsibilities

• Lead and participate in novel research to build a massive scale synthetic data generation pipeline and orchestration solution • Optimize the performance, cost, and resource utilization of AI inference workloads by leveraging the most recent advances for compute & memory optimization techniques. • Contribute to the development of our open-source libraries and frameworks for synthetic data generation and distributed RL frameworks. • Publish research in top-tier AI conferences such as ICML & NeurIPS. • Distill highly technical project outcomes in layman approachable technical blogs to our customers and developers. • Stay up-to-date with the latest advancements in AI/ML infrastructure and tools, synthetic data gen research and proactively identify opportunities to enhance our platform's capabilities and user experience.

Benefits

• Flexible work arrangements, with the option to work remotely or in-person at our offices in San Francisco. • Visa sponsorship and relocation assistance for international candidates. • Quarterly team off-sites, hackathons, conferences and learning opportunities. • Opportunity to work with a talented, hard-working and mission-driven team, united by a shared passion for leveraging technology to accelerate science and AI.