Pro members applied to this job 36 hours before you saw itGet Pro ›

hims-and-hers - Senior Staff SDET, Customer Engineering

Remote - US+ Equity6d ago

Requirements

• 10+ years of hands-on experience in quality engineering or SDET roles, including experience architecting quality strategy and automation platforms across multiple teams. • Proven track record designing and scaling test automation frameworks across the full stack — frontend web, mobile, and backend/API (e.g., Playwright, Cypress, Selenium, Appium, Postman, or similar). • Deep proficiency in one or more programming languages (e.g., JavaScript, TypeScript, Kotlin) used to build and maintain shared automation frameworks and tooling. You write production-quality code, not just test scripts. • Hands-on experience applying AI to testing — LLM-assisted test generation, agent-based workflows, intelligent test selection, or self-healing automation — with informed opinions about where it delivers and where it disappoints. • Demonstrated ability to define quality architecture and standards that scale across many teams, including shared quality platforms and test infrastructure. • Strong grasp of modern development and delivery practices (agile/lean, DevOps, shift-left testing, TDD) and experience embedding quality gates into CI/CD systems (e.g., GitHub Actions, CircleCI, Jenkins). • Experience mentoring and developing senior quality engineers and senior technical leaders, with a track record of raising the technical bar across a group or organization. • History of leading post-incident and root-cause analysis that drives architectural and process change. • Excellent judgment on trade-offs between short-term delivery and long-term system resilience and maintainability. • Strong executive communication skills, with the ability to influence engineering and product leadership on quality strategy, risk, and investment. • Experience with performance and load testing at scale. • Familiarity with LLM observability and evaluation tooling (e.g., Braintrust, Arize, MLflow, LangSmith, or similar). • Experience with cloud-based testing platforms and tools (e.g., AWS Device Farm, Sauce Labs, BrowserStack). • Familiarity with e-commerce or healthcare platforms and quality-at-scale practices in regulated environments. • Experience with internationalization and localization testing. • A track record of building quality engineering communities of practice — tech talks, katas, lunch-and-learns. • Published writing, talks, or open-source work on modern testing practice or AI in quality engineering. • Experience building evaluation or testing infrastructure for LLM-based or ML-driven product features (e.g., eval harnesses, LLM-as-judge scoring, regression testing for non-deterministic systems). • OUR BENEFITS (THERE ARE MORE BUT HERE ARE SOME HIGHLIGHTS): • Competitive salary & equity compensation for full-time roles • Unlimited PTO, company holidays, and quarterly mental health days • Comprehensive health benefits including medical, dental & vision, and parental leave • Employee Stock Purchase Program (ESPP) • 401k benefits with employer matching contribution • Offsite team retreats • Hims considers all qualified applicants for employment, including applicants with arrest or conviction records, in accordance with the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance, the California Fair Chance Act, and any similar state or local fair chance laws. • It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. • Hims & Hers is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, please contact us at [email protected] and describe the needed accommodation. Your privacy is important to us, and any information you share will only be used for the legitimate purpose of considering your request for accommodation. Hims & Hers gives consideration to all qualified applicants without regard to any protected status, including disability. Please do not send resumes to this email address. • To learn more about how we collect, use, retain, and disclose Personal Information, please visit our Global Candidate Privacy Statement https://www.hims.com/global-candidate-privacy-statement.

Responsibilities

• Own quality architecture and strategy • Own quality architecture for our most critical systems and initiatives, defining long-term quality strategy aligned with business and product goals. • Design shared quality platforms, automation frameworks, and test infrastructure that are adopted across multiple teams. • Establish quality patterns and guardrails that scale across teams, eliminating duplicated, brittle, or low-signal testing approaches through platform-level solutions. • Anticipate systemic quality and reliability risks and drive preventative architectural solutions before they impact customers. • Set the standard for what "great" looks like in quality engineering at scale. • Lead our AI-driven testing strategy • Define and drive our strategy for AI-assisted testing — autonomous test generation, intelligent test selection, agent-based failure triage, and self-healing automation — with a clear-eyed view of where each genuinely pays off and where it adds noise. • Build the guardrails that make AI-driven testing trustworthy: knowing when a self-healing agent is masking a real regression versus absorbing harmless implementation drift is the difference between leverage and liability. • Orchestrate AI agents as part of the CI/CD decision pipeline, turning raw test signal into release confidence rather than more dashboards. • Own quality for our AI-powered product features — designing eval suites, golden datasets, LLM-as-judge scorers, and statistical approaches for non-deterministic behavior, plus testing for hallucination, safety, and response stability. • Establish how we test AI-generated application code, validating behavioral correctness and not just syntactic plausibility. • Evaluate emerging AI testing tooling with real rigor, and be honest about what doesn't work. • Raise the bar operationally and across the team • Lead the operational maturity of our quality systems and signals — defining quality metrics, dashboards, and release confidence indicators, and leading post-incident analysis that informs architectural and process improvements. • Produce exemplary technical artifacts — quality architecture documents, automation frameworks, test platforms — that set the bar for the rest of the team, while staying hands-on in critical quality systems and automation code paths. • Serve as the accountable technical leader for strategic initiatives, proactively managing reliability, scalability, and technical debt across teams. • Mentor senior SDETs, quality engineers, and other senior technical leaders — especially on building AI fluency into their practice. • Establish hiring standards, coaching, and talent development. • Champion customer-centric quality decisions, ensuring technical trade-offs reflect real user needs and long-term product value. • Partner with Engineering and Product leadership to embed scalability and resilience into roadmap planning, not just technical design.

Benefits

• AI is the core of the work. You'll own how we use LLMs and agents for test generation, failure triage, self-healing, and release decisioning — and you'll set the guardrails that keep it trustworthy. • You'll test AI, not just test with it. We ship AI-powered product features, which means building evaluation harnesses, golden datasets, and probabilistic assertions for systems that don't return the same answer twice. This is frontier work with very little established playbook. • Real autonomy and real scope. You'll set the technical direction for quality engineering, not inherit someone else's strategy.