Khan Academy - Senior Efficacy Research and Psychometrics Analyst, Khan Kids (24 months fixed-term)
Requirements
• An advanced degree (PhD or Master's) in psychometrics, educational measurement, quantitative methods or a related field — or equivalent applied experience • Strong grounding in psychometric methods, including item analysis, reliability and validity evidence, growth modeling, and Item Response Theory (IRT) • Proficiency with SQL and a statistical programming language (e.g., R or Python) for extracting, cleaning, analyzing, and visualizing data • Experience with (or eagerness to learn) business intelligence tools such as Looker, and comfort building dashboards and data pipelines • Familiarity with responsible data-sharing practices in education research, including student data privacy considerations (e.g., FERPA, COPPA) and work with pseudonymized and deidentified data • Excellent communication skills: able to translate complex psychometric findings into clear implications for product teams, funders, and school partners • Strong project-management and organizational skills, with the ability to coordinate multiple external partners, recurring deliverables, and data-sharing schedules with close attention to detail • Proven cross-cultural competency skills, demonstrating self-awareness, awareness of others, and the ability to adopt inclusive perspectives, attitudes, and behaviors to drive inclusion and belonging throughout the organization • Motivated by Khan Academy’s mission “to provide a free, world-class education for anyone, anywhere” • Experience with (or strong interest in) early childhood education and assessment of young learners is a plus
Responsibilities
• (1) Psychometrics & Efficacy Research • Lead our psychometric research partnership: Serve as the primary technical point of contact for our external psychometric research partnership, supporting study design, data sharing, psychometric analyses, and interpretation of findings • Lead our psychometric research partnership • Extract, clean, and securely share assessment data with research partners on a recurring schedule • Analyze and interpret psychometric findings, including item difficulty, score distributions, growth analyses, concurrent validity, and IRT-based scoring • Partner with our product and engineering teams to translate findings into product improvements, such as updates to scoring models and assessment discontinuation rules • Collaborate with research partners to develop and publish technical documentation, beginning with the technical manual for our PreK assessment • Recruit and manage research partner sites: Recruit and onboard school and district sites for psychometric and efficacy studies; execute MOUs; align on consent procedures and participant incentives; and coordinate site visits for direct child assessment data collection • Recruit and manage research partner sites: • Partner with our legal team to draft and negotiate data-sharing agreements with districts and research organizations, including requirements for pseudonymized and identified data • Partner with our legal team • Support efficacy research. Coordinate Khan Academy Kids' participation in ongoing efficacy studies and contribute to the design of future studies, aligning internal and external stakeholders on the research approach • Support efficacy research. • (2) Analytics Reporting and Data Infrastructure • Own Khan Kids’s KPI dashboard: Partner with our engineering team to build and maintain the Khan Academy Kids analytics dashboard, including integrations with App Store Connect and Google Play Console. Maintain the dashboard so it can be used by other teams including marketing, school partnerships, and philanthropy. • Own Khan Kids’s KPI dashboard: • Lead recurring reporting: Prepare recurring app performance reporting, including monthly and quarterly business reviews and periodic target setting. Field ad hoc data requests across teams — for example, writing new SQL queries to support targeted district outreach or grant reporting. • Lead recurring reporting:
Benefits
• We may be a non-profit, but we reward our talented team extremely well! We offer: • Competitive salaries • Ample paid time off as needed – Your well-being is a priority • 8 pre-scheduled Wellness Days in 2026 occurring on a Monday or a Friday for a 3-day weekend boost • Remote-first culture - that caters to your time zone, with open flexibility as needed, at times • Generous parental leave • An exceptional team that trusts you and gives you the freedom to do your best • The chance to put your talents towards a deeply meaningful mission and the opportunity to work on high-impact products that are already defining the future of education • Opportunities to connect through affinity, ally, and social groups • And we offer all those other typical benefits as well: 401(k) + 4% matching & comprehensive insurance, including medical, dental, vision, and life • At Khan Academy we are committed to fair and equitable compensation practices, the well-being of our employees, and our Khan community. This belief is why we have built out a robust Total Rewards package that includes competitive base salaries, and extensive benefits and perks to support physical, mental, and financial well-being. The compensation band for this role is $137,871 - $155,105 USD annually for candidates based in the United States and $186,306 - $209,595 CAD annually for candidates based in Canada. The pay range for this position is a general guideline only. The salary offered will depend on internal pay equity and the candidate’s relevant skills, experience, qualifications, and job market data.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT