apolloresearch - Apollo Research - Research Scientist/Engineer (Evaluations)

London & San Francisco$50k - $50k+ Equity8mo ago

Remote EMEA Artificial Intelligence Research Scientist Research Engineer Data Analysis Python Apollo

Requirements

• Strong software engineering experience in Python. Experience shipping and maintaining production code preferred. Skill in creating clean abstractions for others to use is a plus. • Ability to optimize processes and reduce friction within workflows where possible, given the fast pace of pre-deployment evaluations. • Proficiency in data analysis and pattern recognition from large datasets; ability to identify anomalies and unexpected model behaviors. • Skill in succinctly communicating findings both quantitatively and qualitatively to technical and non-technical audiences. • Curiosity about frontier AI models, experience with different types of models, understanding when not to use AI, familiarity with experimenting new AI workflows. (Bonus) Experience using Inspect as the primary evaluation framework is preferred but not mandatory.

Responsibilities

• Run pre-deployment evaluation campaigns on the most capable AI systems in the world. • Deep dive into AI cognition by analyzing model transcripts to identify behavioral patterns. • Build new evaluations for frontier risks, including designing test environments and scaling them across scenarios. • Collaborate with frontier AI developers by sharing findings and engaging in feedback loops that inform deployment decisions. • Automate and enhance the evaluation pipeline to adapt to emerging agent capabilities.

Benefits

• Equity options mentioned: "We offer equity to all employees." • PTO policy is specified as generous unlimited vacation time with no loss of pay for partial days off and the ability to take extended leaves without penalty, provided proper notice is given. • Insurance benefits are detailed including health insurance (with a company contribution), dental coverage, vision care, life insurance at 10 times your annual salary up to $50k per year for yourself or dependents and disability income protection with the option of additional riders like accidental death benefit. • Perks include free meals/snacks provided in our office cafeteria (with a choice between hot, cold, vegan options), onsite gym access, dry cleaning service for work attire at no cost to employees, and subsidized parking up to $20k per year. • Remote work policy is flexible: "We offer the option of working remotely."