Lead Data Scientist, Product Analytics

ABOUT THE ROLE

We are seeking an experienced data scientist to supervise and manage our experimentation and testing initiatives! As a Lead Data Scientist, you will be responsible for developing and executing experimentation strategies, performing statistical analysis, defining product metrics and providing insights that help drive business outcomes.

This is a new and exciting role within our product organization that will be supporting several teams by serving as the SME on experimental design and implementation of statistical techniques for measurement to drive data driven decision making across our product organization. 

YOUR DAILY IMPACT AT PELOTON

• Be the subject matter expert in experimentation by understanding our current product offerings and find ways to optimize for experimentation at scale.

• Evangelize a “test and learn” mindset by developing and maintaining experimentation best practices and guidelines.

• Collaborate with cross-functional teams to understand the current ways of experimentation, identify shortcomings and propose alternatives that accelerate the speed of experimentation.

• Work closely with product teams across the organization to identify opportunities for experimentation, help design and execute them to drive business growth. 

• Support the complete life cycle of A/B tests right from the test setup recommendation to defining the relevant success metric to sample size planning to prioritization of the test along with post-test statistical lift analysis.

• Partner with Machine Learning engineers to support measurement and evaluation of recommendation engines, driving key guidance on improvement areas.

• Stay up-to-date with industry trends and developments in experimentation and testing.

• Design, develop and implement statistical models and algorithms that help optimize the performance of our products and services including Personalization.

• Hypothesize and design relevant lagging and leading indicators for member engagement that inform our product strategy.

• Mentor and coach other data scientists in the organization by continuously providing technical guidance on their tests and sharing relevant papers/talks from conferences and academia.

• Work towards being a trusted advisor to senior leadership on experimentation and help define a roadmap that aligns with product priorities. 

YOU BRING TO PELOTON

• Master’s degree in a relevant field such as statistics, data science, or computer science; PhD is highly preferred.

• 5+ years of relevant experience in data science and experimentation with a strong understanding of correlation vs. causation principles and methods including but not limited to counterfactual evaluation, propensity score matching, doubly robust estimation methods etc. 

• Expert in conducting causal studies on observational data to identify causal relationships that provide statistical rigor to data driven insights. 

• Proven analytical skills with experience in data analysis tools such as SQL or Python, with experience using machine learning libraries such as scikit-learn, TensorFlow or PyTorch.

• Excellent communication and interpersonal skills with the ability to work across teams and stakeholders with varying seniority and technical knowledge.

• Demonstrated ability to collaborate with cross-functional teams and has good understanding of both client- and server-side A/B testing. 

• Experience with various methods for data visualization and presenting data in a way that can be easily consumed by less technical audiences

#LI-CS3

LI-HYBRID