LaunchDarkly - Staff Engineer – Experimentation Team
Requirements
• 10+ years building large-scale experimentation platforms, statistical analysis systems, or data-intensive backend services. • Applied-statistics knowledge: hypothesis testing, sequential analysis, variance reduction (CUPED), power analysis, experiment design. Comfortable with frequentist vs. Bayesian trade-offs. • Experience with adaptive experimentation ML — contextual bandits, Thompson sampling, Bayesian optimization, or RL-based allocation. • Track record designing warehouse-agnostic systems across Snowflake, Databricks, Redshift, BigQuery, or similar. • Expertise in Go, Python, or similar for backend services and statistical computation. • Experience with event-driven architectures, data pipelines, and large-scale data processing. • Cloud environments (AWS, GCP) with infrastructure-as-code. • Technical leadership: setting direction, breaking down complex problems, influencing across teams. • Ability to translate statistical concepts for product and engineering audiences. • Target pay ranges based on Geographic Zones* for Level 5: • Zone 1: San Francisco/Bay Area or NYC Metropolitan Area, Boston, Seattle - $214,800 - $295,350* • Zone 2: Irvine, LA, Monterey, Santa Barbara, Santa Rosa, Austin, Portland, Philadelphia, Chicago - $193,400 - $265,870** • Zone 3: All other US locations - $182,600 - $251,0202** • LaunchDarkly operates from a place of high trust and transparency; we are happy to state the pay range for our open roles to best align with your needs. Exact compensation may vary based on skills, experience, and location. • Within the United States, our geographic pay zones are defined by counties surrounding major metropolitan areas.**Restricted Stock Units (RSUs), health, vision, and dental insurance, and mental health benefits in addition to salary. • Modern software delivery was supposed to be the foundation for a thriving digital business but reality has proven otherwise. Slow, inefficient development cycles, costly outages, and fragmented customer experiences are preventing developers from building their best software. The LaunchDarkly platform helps developers innovate on new features faster while protecting them with a safety valve to instantly rewind when things go wrong. Developers can target product experiences to any customer segment and maximize the business impact of every feature. And by gradually rolling out new application components, they escape nightmare "big-bang" technology migrations. • The LaunchDarkly platform was built to guide engineers to the next frontier of DevOps by: • Improving the velocity and stability of software releases, without the fear of end customer outages • Delivering targeted experiences by easily personalizing features to customer cohorts • Maximizing the business impact of every feature through the ability to experiment and optimize • Coordinating the release and optimization of software to provide consistent experiences across mobile platforms and device types • Improving the effectiveness and productivity of engineering teams, by providing insights into engineering cadence and stability
Responsibilities
• Build the experimentation statistical engine — hypothesis testing, sequential analysis, variance reduction (CUPED, Winsorization), power analysis. Ensure statistical correctness across all experiment types. • Design warehouse-native experimentation that runs analysis inside customer warehouses (Snowflake, Databricks, Redshift, BigQuery). Build modular, warehouse-agnostic abstractions for rapid new backend support. • Lead adaptive experimentation — contextual bandit systems, Bayesian optimization, automated allocation beyond simple A/B tests. • Drive the platform roadmap with product, design, and data science. Shape what we build, not just how. • Collaborate cross-functionally with Warehouse Integrations, SDK, Platform, and Data Science teams. • Mentor engineers and raise the team's bar for statistical rigor and system design. • Own operational excellence — monitoring, observability, incident response, on-call. Robust telemetry and alerting.
Apply in one click
Upload My Resume
Drop here or click to browse · Tap to choose · PDF, DOCX, DOC, RTF, TXT