Pearl - Head of AI Data Solutions
Requirements
• You have experience in AI data services, AI data product leadership, ML research operations, AI partnerships, or a related field. • You have built or operated high-quality human data programs such as supervised fine tuning, preference data, evaluations, verifiers, critiques, or rubric-driven QA. • You are comfortable working with ML researchers, engineers, and technical product teams on dataset design, formats, and evaluation methodology. • You know how to turn ambiguous customer or research needs into structured workflows and production-ready delivery plans. • You have strong operational judgment and understand what it takes to build quality, trust, and repeatability in a fast-moving environment. • Experience with data rights, licensing, confidentiality, or enterprise-grade data delivery is strongly preferred. • Ideal backgrounds may include • AI data procurement or partnerships at a frontier AI lab or model-building organization • Senior leadership at a custom AI data provider such as Scale, Appen, Prolific, or a similar company • Data product or research operations leadership in an AI-native environment
Responsibilities
• You will define and productize Pearl’s AI data offerings, including how they are packaged, delivered, measured, and improved over time. • You will build the delivery engine for expert data programs across staffing, workflows, tooling, QA, and automation. • You will establish the quality bar through rubrics, audits, calibration, gold sets, verifiers, and continuous performance scoring. • You will partner closely with customers to translate ambiguous training and evaluation needs into clear task designs, workflows, and production-ready specifications. • You will help shape Pearl’s data rights and licensing strategy with Legal so we can scale responsibly while protecting confidentiality, privacy, and customer trust. • You will also help build Pearl’s credibility in the market by defining clear standards for what elite expert data looks like. • Examples of programs you may build • Expert training data for specialized domains • Preference and ranking data with strong rubrics • Evaluation programs for truthfulness, reasoning, safety, and policy adherence • Verifier, critique, and structured feedback workflows • Hard-case and adversarial datasets that expose model failure modes • Agentic and long-horizon tasks involving tools, software, and decision-making • Multimodal programs across text, voice, and computer-use environments
Benefits
• A strong leader in this role could unlock a significant new business for Pearl by helping us deliver expert training and evaluation data to leading AI labs. This is an opportunity to build something important from the ground up and define a category where Pearl has a real right to win. • Remote From these States • California, Florida, Georgia, Idaho, Illinois, Massachusetts, Michigan, New Jersey, New York, North Carolina, Ohio, Oregon, Pennsylvania, Texas, Virginia, Washington, and Wisconsin. • Pay Transparency • Pay Transparency • Pearl will provide pay transparency information upon application to those in qualifying jurisdictions. Employment is with JustAnswer LLC, a Pearl company. • Our Commitment to an Inclusive Workplace
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT