i.AI - AI Evaluation Engineer (Data Scientist)
Responsibilities
• Design and build evaluation pipelines and experiments for AI products • Run model and system evaluations to assess accuracy, bias, safety and overall performance • Work closely with product and engineering teams to embed evaluation throughout the product lifecycle, from early scoping through to scaling • Partner with domain experts to create and maintain high-quality golden datasets and evaluation benchmarks • Analyse evaluation results and turn findings into clear, practical recommendations for product teams • Help teams understand the impact of AI products on the quality and efficiency of public service delivery • Contribute to reports, presentations and other outputs that communicate evaluation findings to technical and non-technical audiences • Support the development of robust evaluation approaches that can be reused across different AI products and services • You may be a strong fit if you bring some of the following: • Experience in a scientific, analytic or engineering role • Excellent analytical and critical thinking skills, with the ability to synthesise complex information and draw insights from data • Practical knowledge of experimental design and statistical hypothesis testing • Proficient in Python • Ability to use version control tools (e.g. git) • Experience of evaluating generative or predictive AI/ML systems • Experience of working as part of a software development team • Ability to communicate technical work to a broad audience
Benefits
• Career-defining projects with outsized impact • Backing from the Prime Minister and No10 to scope and build transformative AI projects. • Unique opportunities to apply technology that could transform the public sector and impact citizens’ lives. • Talented, supportive and mission-driven colleagues. • Access to frontier models and ample compute. • Extensive operational, product, strategy, design and delivery support so you can focus on shipping. • Work with experts across national security, policy, AI research and adjacent sciences. • Growth & empowerment • A team culture and development support that prioritises personal growth. • Opportunities to own important products early and develop them in small empowered teams. • 5 days off learning and development, annual stipends for learning and development and funding for conferences and external collaborations. • Life & family* • Opportunity to work from London, Manchester or Bristol offices. • Hybrid working, flexibility for occasional remote work abroad and stipends for work-from-home equipment. • Generous annual leave - 25 days plus one additional day for each year of service • Generous paid parental leave (up to 39 weeks full pay + option for additional unpaid time). • On top of your salary, we contribute 28.97% of your base salary to your pension. • Discounts and benefits for cycling to work, dental insurance, donations and retail/gyms. • These benefits apply to direct employees. Benefits may differ for people joining through other employment arrangements such as secondments. • Salary is paid within the range shown below. As this is a GDaD role, the maximum salary includes a non-pensionable technical allowance, and successful candidates will be appointed somewhere within that range depending on assessment of skills demonstrated during the interview process. Base salary for candidates joining from outside the civil service be the minimum of the pay band. • National: £45,740 - £59,835 (maximum includes non-pensionable technical allowance of up to £9,000)London: £48,540 - £62,970 (maximum includes non-pensionable technical allowance of up to £9,000)
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT