poolside - Member of Engineering (Evaluations)

Remote - (EMEA/East Coast)3mo ago

Remote EMEA Artificial Intelligence Software Distinguished Engineer Python

Requirements

• Experience with Large Language Models (LLM) • Strong understanding and intuition of LLMs, and their limitations • Good taste, and a curious mindset • Strong engineering background • Strong programming skills, ideally across multiple languages • Familiar with full software development life cycle • Multiple languages, including Python • Use modern tools and are always looking to improve • Strong critical thinking and ability to question code quality policies when applicable • Intro call with one of our Founding Engineers • Technical Interview(s) with one of our Founding Engineers • Team fit call with the People team • Final interview with one of our Founding Engineers

Responsibilities

• Research and implementation of evaluations and benchmarks; both for base models and for instruction following models • Collaborate with both applied research and product teams to define meaningful metrics and evaluations that capture our progress on real world software development skills • Work in a team: plan future steps, discuss, and communicate clearly with your peers

Benefits

• Fully remote work & flexible hours • 37 days/year of vacation & holidays • Health insurance allowance for you and dependents • Company-provided equipment • Wellbeing, always-be-learning and home office allowances • Frequent team get togethers • Great diverse & inclusive people-first culture