Tripadvisor - Senior Data Scientist, Experimentation
Requirements
• Experience: Extensive experience in data science or a similar quantitative role, with a proven track record of supporting and influencing a product organisation. • Statistical & Experimentation Expertise: Authoritative command of experimentation in all its forms, from experimental design and variance reduction to causal inference, bandits and Bayesian methods. You should be able to develop and validate methodology, not only apply it. • Statistical & Experimentation Expertise: • Technical & Modelling Expertise: Expert level proficiency in Python and SQL. Deep, hands-on experience with statistical modelling, (quasi) experimentation, multi-arm bandits, and a wide range of machine learning techniques such as regression, classification and clustering. • Technical & Modelling Expertise: • Product Acumen: Demonstrated ability to define, implement and operationalise crucial product and feature-level metrics from scratch. • Product Acumen: • Partnership & Enablement: Demonstrated ability to improve how other teams work by providing guidance, tooling and protocols, increasing both the speed and the quality of their experimentation rather than absorbing the work yourself. • Partnership & Enablement: • Decision Impact & Platform Health: Ability to critically assess how product decisions affect platform health and growth over time, and to bring that perspective into how experiments are designed and interpreted. • Decision Impact & Platform Health: • Standardising at Scale: Experience standardising processes, frameworks or methods across multiple teams, including the use of AI and automation to make good practice the default. • Standardising at Scale: • Cross-Functional Partnership: Proven ability to build strong relationships and drive outcomes across Product, Engineering, Data Platform and other central functions, often without direct authority. • Cross-Functional Partnership: • Critical Thinking: Leader in critical thinking, with a demonstrated habit of establishing whether a result is trustworthy before establishing what it means. • Critical Thinking: • Communication: Exceptional ability to explain measurement, method and uncertainty clearly to technical and non-technical audiences at every level. • Communication: • Education: Bachelor's degree in Statistics, Mathematics, Data Science, Engineering, Physics, Economics, or a related quantitative field. • Education: • You could be an especially great fit if you have: • Experience with experimentation in a marketplace, where interference between users and shared supply complicate measurement. • Experience with variance reduction beyond a single pre-period covariate, and a view on what works when the metric of interest is infrequent or heavy-tailed. • Experience building or validating proxy metrics for long-horizon outcomes. • Exposure to Bayesian approaches, particularly for low-traffic surfaces or pooling evidence across small markets. • Experience with SaaS experimentation tools such as Statsig, Eppo or GrowthBook, or with an in-house platform. • Experience in a high-scale marketplace, e-commerce or travel platform, and familiarity with the seasonality and long purchase cycles that come with them. • Experience improving experimentation practice at team or organisational level through frameworks, tooling or enablement. • Experience applying AI or Large Language Model capabilities to improve analytical throughput and experimentation quality. • We strive to create an accessible and inclusive experience for all candidates. If you need a reasonable accommodation during the application or the recruiting process, please make sure to reach out to your individual recruiter or our team at [email protected]. • [email protected] • If you have any additional questions about careers at Tripadvisor you can email us at [email protected]. We have all the answers! • [email protected]
Responsibilities
• As a Senior Data Scientist on our experimentation team you will work across a range of product areas, acting as the partner that Product and Engineering teams rely on to know how to set up and run investigations, whether a change worked and why it worked. • Much of your impact will come from improving how those teams experiment rather than running their experiments for them: the metrics, guidance, tooling and protocols that let them move quickly without sacrificing rigour. • You will also lead the measurement problems a standard A/B test cannot answer, where traffic is limited, users compete for the same supply, or the outcomes that matter take months to appear. • Own the experimentation and measurement strategy for your domain, from how questions are framed through to how decisions are made and reviewed. • Provide the guidance, tooling and protocols that improve your partner teams' experimentation velocity without sacrificing rigour. • Lead the design of experiments where a standard A/B test is not sufficient, including low-traffic surfaces, users competing for the same supply, long-horizon or censored outcomes, and changes that cannot be cleanly randomised. • Go beyond whether a change worked to why it worked and whether it generalises across users, markets and time. • Assess how the decisions your teams make affect platform health and growth, and raise it when short-term wins carry a longer-term cost. • Define and operationalise the metric framework for your domain, including guardrails and proxies for outcomes that take too long to observe directly. • Improve the sensitivity of measurement in your area through metric design, variance reduction and better exposure definition, so teams can detect the effects they care about in a realistic timeframe. • Standardise the recurring analytical and experimentation processes in your domain, using automation and AI capabilities where they improve consistency or save time. • Influence roadmap and prioritisation through evidence, including advocating against work when the evidence doesn't support it. • Raise technical quality in the teams you work with by reviewing experiment designs and analyses, and mentoring less experienced data scientists.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT