i.AI - Performance Analyst
Responsibilities
• Estimating the potential benefits of candidate AI tools, such as time saved or improvements in service quality, to inform decisions about which products the incubator pursues • Tackling more open-ended analytical questions, such as modelling how wider use of AI agents might change the volume and nature of requests to public services ("agentic flooding") • Supporting product teams to quantify the impact of their products, working with the evaluation team on model evaluations and impact evaluations, including experimental and quasi-experimental designs • Monitor evaluation and performance metrics across the incubator's portfolio • Work with product teams to develop theories of change and identify which metrics they should track • Support spending review submissions by identifying, gathering and quality assuring figures from across the incubator • You may be a strong fit if you bring some of the following: • Experience of quantitative analysis, gained through work or study • Excellent analytical and critical thinking skills, including the ability to structure ambiguous problems and make reasoned estimates where data is limited • Working knowledge of statistical methods and research design • Proficient in an analytical programming language, such as Python or R • Ability to explain analysis, and its uncertainties and limitations, clearly to non-specialist audiences • Enthusiasm for learning new methods and taking on unfamiliar problems • Familiarity with impact evaluation methods, such as randomised controlled trials, difference-in-differences or regression discontinuity • Experience of appraisal, cost-benefit analysis or modelling, for example using the HM Treasury Green Book or Magenta Book • Interest in AI and its application to public services • Ability to use version control tools (e.g. git) • Which role should I apply for? • We are also recruiting AI Evaluation Engineers. That role focuses on how well AI models perform: building and running evaluation pipelines in Python to test accuracy, bias and safety. This Performance Analyst role looks at the bigger picture: whether a tool is worth building, what difference it makes to public services, and how AI may change demand on government. If you're most excited by writing code to test models, apply for the Evaluation Engineer role. If you'd rather estimate benefits, help design impact evaluations and tackle open-ended analytical questions, apply for this one.
Benefits
• Career-defining projects with outsized impact • Backing from the Prime Minister and No10 to scope and build transformative AI projects. • Unique opportunities to apply technology that could transform the public sector and impact citizens’ lives. • Talented, supportive and mission-driven colleagues. • Access to frontier models and ample compute. • Extensive operational, product, strategy, design and delivery support so you can focus on shipping. • Work with experts across national security, policy, AI research and adjacent sciences. • Growth & empowerment • A team culture and development support that prioritises personal growth. • Opportunities to own important products early and develop them in small empowered teams. • 5 days off learning and development, annual stipends for learning and development and funding for conferences and external collaborations. • Life & family* • Opportunity to work from London, Manchester or Bristol offices. • Hybrid working, flexibility for occasional remote work abroad and stipends for work-from-home equipment. • Generous annual leave - 25 days plus one additional day for each year of service • Generous paid parental leave (up to 39 weeks full pay + option for additional unpaid time). • On top of your salary, we contribute 28.97% of your base salary to your pension. • Discounts and benefits for cycling to work, dental insurance, donations and retail/gyms. • These benefits apply to direct employees. Benefits may differ for people joining through other employment arrangements such as secondments. • Base salary for candidates joining from outside the civil service be the minimum of the pay band.National: £45,740 - £50,835London: £48,540 - £53,970 • Selection Process • Selection Process • Appointment is conditional on successfully completing UK Government SC clearance. Prior clearance is not required—we will sponsor and support you. You should normally have been resident in the UK for 2 of the past 5 years. Employment is conditional on obtaining and maintaining the required clearance(s). More detail on clearance eligibility can be found on the UK Government website: National security vetting: clearance levels - GOV.UK • Appointment is conditional on successfully completing UK Government SC clearance. Prior clearance is not required—we will sponsor and support you. • In accordance with the Civil Service Commission rules, the following list contains all elements of the selection process. • Candidates should expect to go through some or all of the following stages once an application has been submitted: • Preliminary call – a short initial conversation with members of the team you’d be joining • Preliminary call • Technical Behavioural interview – ahead of the interview, you’ll be sent a technical exercise which should take around 1.5 hours to complete. You’ll spend the first 10 minutes of the interview presenting your approach, followed by behavioural questions focused on your previous experience and how you approach different workplace situations • Technical Behavioural interview • Senior leadership conversation – a final discussion with members of the senior leadership team • Senior leadership conversation • Diversity and Inclusion • The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window). As part of the application process, we monitor statistics on D&I. You can see how we process this data here: Recruitment privacy notice - GOV.UK. • £45,740—£53,970 GBP
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT