Lila Sciences - Senior Specialist / Manager, AI Safety Data and Evaluation Program
Requirements
• Experience delivering expert-data, research-operations, evaluation or similarly demanding programs involving specialist contributors. • A substantial working understanding of AI safety, including how threat models, capability evaluations, red teaming and safeguards inform one another. You should be able to interpret a safety research brief, recognize its assumptions and the consequences of data-quality failures, and identify when a question needs scientific escalation. • Evidence of applying this safety understanding in research, evaluation or expert-data work, including how it shaped the scoping, execution or review of a program. • Strong operational judgment and the ability to manage dependencies, changing requirements and several parallel workstreams. • A track record of setting measurable quality standards, detecting recurring problems and improving the processes that produce data. • Clear communication, careful documentation and the ability to build effective relationships with researchers, experts and vendors. • Sufficient technical and scientific fluency to understand research briefs, clarify ambiguity and work productively with subject-matter experts. • Experience contributing to scientific study design, assessing scientific validity or developing evaluation rubrics. • Deeper scientific expertise or research experience in biology, chemistry or materials science. • Data analysis, scripting, annotation platforms or tools for tracking research workflows and data provenance.
Responsibilities
• What You'll Be Building • Translate agreed scientific briefs into executable plans covering tasks, contributor needs, instructions, milestones, quality standards and delivery expectations. • Source and coordinate external experts with scientific colleagues, and organize access to relevant expertise within Lila. • Manage contributor onboarding, task assignment, training and support so specialists can contribute effectively and consistently. • Run expert-data collection, annotation, red-teaming and evaluation programs, tracking progress and resolving delivery problems. • Establish quality controls covering completeness, consistency, provenance and adherence to rubrics; coordinate calibration, review, disagreement resolution and rework with scientific owners. • Maintain clear records, versioned guidance and usable datasets, and improve workflows based on quality findings and researcher feedback. • Identify questions that require scientific judgment and bring them to the appropriate specialists, ensuring decisions are reflected in program materials and subsequent work.
Benefits
• We offer competitive base compensation with bonus potential and generous early-stage equity. Your final offer will reflect your background, expertise, and expected impact. • U.S. Benefits. Full-time U.S. employees receive a comprehensive benefits program including medical, dental, and vision coverage; employer-paid life and disability insurance; flexible time off with generous company wide holidays; paid parental leave; an educational assistance program; commuter benefits, including bike share memberships for office based employees; and a company subsidized lunch program. • International Benefits. Full-time employees outside the U.S. receive a comprehensive benefits program tailored to their region. USD salary ranges apply only to U.S.-based positions; international salaries are set to local market. • $88,000—$144,000 USD • Lila Sciences is building Scientific Superintelligence™ to solve humankind's greatest challenges. We believe science is the most inspiring frontier for AI. Rather than hard-coding expert knowledge into tools, LILA builds systems that can learn for themselves. • LILA combines advanced AI models with proprietary AI Science Factory™ instruments into an operating system for science that executes the entire scientific method autonomously, accelerating discovery at unprecedented speed, scale, and impact across medicine, materials, and energy. Learn more at www.lila.ai. • Guided by our core values of truth, trust, curiosity, grit, and velocity, we move with startup speed while tackling problems of historic importance. If this sounds like an environment you'd love to work in, even if you don't meet every qualification listed above, we encourage you to apply. • We’re All In • Lila Sciences is committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. • Information you provide during your application process will be handled in accordance with our Candidate Privacy Policy. • A Note to Agencies • A Note to Agencies • Lila Sciences does not accept unsolicited resumes from any source other than candidates. The submission of unsolicited resumes by recruitment or staffing agencies to Lila Sciences or its employees is strictly prohibited unless contacted directly by Lila Science’s internal Talent Acquisition team. Any resume submitted by an agency in the absence of a signed agreement will automatically become the property of Lila Sciences, and Lila Sciences will not owe any referral or other fees with respect thereto.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT