hims-and-hers - Staff Analyst, AI Product
Requirements
• 8+ years of experience in analytics, data science, or a related quantitative field • Bachelor's degree in Statistics, Mathematics, Economics, Computer Science, Engineering, or a related field • 5+ years of experience designing, executing, and analyzing A/B tests, ideally including tests on AI/ML-driven product experiences • Experience partnering with ML teams to evaluate model outputs and translate them into product/business metrics (e.g., classification accuracy, confidence scores, resolution quality) • Extensive experience working with data engineering and analytics engineering teams, including dbt-modeled production pipelines • Strong knowledge of experimental design and statistical inference; experience applying causal inference techniques beyond standard A/B testing, such as quasi-experimental methods or observational study design (e.g., fixed-effects regression, survival analysis) • Experience with subscription-based business models and metrics, including cohort analysis, retention/churn analysis, and addressability sizing • Expert SQL skills (BigQuery preferred) and advanced experience with Looker or Tableau • Ability to explain technical analyses clearly to non-technical audiences, including senior leadership • Experience shaping and influencing product strategy, not just executing analyses • A proactive, ownership-driven mindset with strong organizational and prioritization skills • Experience evaluating conversational AI or LLM-based products (intent classification, containment/escalation, hallucination or quality monitoring) • Familiarity with telehealth concepts or subscription-based healthcare models, including clinical safety considerations in AI-assisted workflows • Experience with GrowthBook or a comparable experimentation platform • Experience with survival analysis or time-to-event modeling (e.g., lifelines, pyfixest, statsmodels) • dbt, Airflow, and Databricks experience • Our Benefits (there are more but here are some highlights): • Competitive salary & equity compensation for full-time roles • Unlimited PTO, company holidays, and quarterly mental health days • Comprehensive health benefits including medical, dental & vision, and parental leave • Employee Stock Purchase Program (ESPP) • 401k benefits with employer matching contribution • Offsite team retreats • Hims considers all qualified applicants for employment, including applicants with arrest or conviction records, in accordance with the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance, the California Fair Chance Act, and any similar state or local fair chance laws. • It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. • Hims & Hers is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, please contact us at [email protected] and describe the needed accommodation. Your privacy is important to us, and any information you share will only be used for the legitimate purpose of considering your request for accommodation. Hims & Hers gives consideration to all qualified applicants without regard to any protected status, including disability. Please do not send resumes to this email address. • To learn more about how we collect, use, retain, and disclose Personal Information, please visit our Global Candidate Privacy Statement https://www.hims.com/global-candidate-privacy-statement.
Responsibilities
• Provide thought leadership and strategic partnership to AI Product stakeholders, influencing roadmap and investment decisions with data-driven insight into AI product performance • Own experimentation strategy for AI product launches and iterations (e.g., GrowthBook-based tests), including test design, success metrics, sample-size estimation, guardrails, and results interpretation • Apply causal inference and quasi-experimental methods — including fixed-effects models, difference-in-differences, and propensity score matching — to assess AI impact on retention and clinical/operational outcomes when randomized tests aren't feasible • Define, validate, and own metrics frameworks and measurement plans for new and evolving AI product use cases — from pre-launch instrumentation through post-launch readouts — translating ambiguous business questions into rigorous, well-instrumented metrics within a complex, multi-source data environment • Partner with ML/Applied AI teams to evaluate model performance in production and translate model-level signals (confidence, escalation type, resolution outcome) into product and business metrics • Own commercial impact analysis for AI products — cost savings, handle-time efficiency, and support deflection — and quantify retention/churn addressability to size the impact of AI initiatives • Work cross-functionally with AI/ML Engineering, Analytics Engineering, and Data Engineering teams to define tracking requirements and ensure data integrity across AI product pipelines and event schemas • Use Python or R alongside SQL to develop scalable analytical solutions (e.g., observational studies, survival/retention modeling) that go beyond what dashboards alone can answer • Design intuitive Looker dashboards that democratize AI product metrics and elevate self-service across Product and Care Operations teams • Conduct deep-dive analyses — including user/session segmentation — to answer strategic questions about AI product performance, identify where AI products are (and aren't) working, quantify opportunity areas, and recommend clear actions • Champion data quality, documentation, and deliverable consistency across dbt models and BigQuery tables that power AI metrics, while mentoring junior analysts
Benefits
• $155K – $190K • Offers Equity • The actual amount will take into account a range of factors that are considered in making compensation decisions, including but not limited to skill sets, experience and training, licensure and certifications, and location. H&H also offers a comprehensive Total Rewards package that may include an equity grant. • Consult with your Recruiter during any potential screening to determine a more targeted range based on location and job-related factors. • This job has application limits • To ensure that we can give proper consideration to everyone who's excited about joining Hims & Hers, we ask that you please only apply to a specific role once within a 60-day period. If you weren’t selected this time, you are welcome to check back and reapply after 60 days. • We truly appreciate your interest in Hims & Hers and look forward to staying connected! • Autofill from resume • Upload your resume here to autofill key application fields. • Drop your resume here! • Parsing your resume. Autofilling key fields... • Candidate Information • LinkedIn Profile URL • If you don't have a LinkedIn profile, please write NA • or drag and drop here • Do you have at least 8 years of experience in analytics, data science, or a related quantitative field? • Do you have at least 5 years of experience designing, executing, and analyzing A/B tests, including on AI or ML driven product experiences? • Which causal inference or quasi experimental methods have you personally applied in a professional setting? Please list all that apply (for example: difference in differences, propensity score matching, fixed effects regression, survival analysis, other). • Describe a time you built or owned a metrics framework or measurement plan from scratch for a new product or feature that had little to no existing instrumentation. What was the business question you were trying to answer, how did you define success, and how did you get it tracked correctly across a complex, multi source data environment? • Are you legally authorized to work in the U.S. without restriction for any employer? • Will you now or in the future require immigration sponsorship by Hims & Hers in order to work for Hims & Hers in the U.S.? • Have you previously worked for hims & hers as an employee or contractor/consultant? • This includes any subsidiary companies, including but not limited to Apostrophe or Honest Health. • Recruiting Privacy Policy • Submit Application • Hims & Hers may use Artificial Intelligence with this application. Learn more.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT