poolside - Member of Engineering (Evaluations)
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT
Requirements
• Experience with Large Language Models (LLM) • Strong understanding and intuition of LLMs, and their limitations • Good taste, and a curious mindset • Strong engineering background • Strong programming skills, ideally across multiple languages • Familiar with full software development life cycle • Multiple languages, including Python • Use modern tools and are always looking to improve • Strong critical thinking and ability to question code quality policies when applicable • Intro call with one of our Founding Engineers • Technical Interview(s) with one of our Founding Engineers • Team fit call with the People team • Final interview with one of our Founding Engineers
Responsibilities
• Research and implementation of evaluations and benchmarks; both for base models and for instruction following models • Collaborate with both applied research and product teams to define meaningful metrics and evaluations that capture our progress on real world software development skills • Work in a team: plan future steps, discuss, and communicate clearly with your peers
Benefits
• Fully remote work & flexible hours • 37 days/year of vacation & holidays • Health insurance allowance for you and dependents • Company-provided equipment • Wellbeing, always-be-learning and home office allowances • Frequent team get togethers • Great diverse & inclusive people-first culture
No credit card. Takes 10 seconds.