Название: Practical A/B Testing: Creating Experimentation-Driven ProductsАвтор: Leemay Nassery
Издательство: Pragmatic Bookshelf
Год: May 2023 (Version: P1.0)
Страниц: 209
Язык: английский
Формат: pdf, epub
Размер: 10.2 MB
Whether you're a catalyst for organizational change or have the support you need to create an engineering culture that embraces A/B testing, this book will help you do it right. The step-by-step instructions will demystify the entire process, from constructing an A/B test to breaking down the decision factors to build an engineering platform. When you're ready to run the A/B test of your dreams, you'll have the perfect blueprint.
With smart, tactful approaches to orchestrating A/B testing on a product, you'll quickly discover how to reap all the benefits that A/B testing has to offer - benefits that span your users, your product, and your team. Take the reins today, and be the change you want to see in your engineering and product organizations.
Develop a hypothesis statement that's backed with metrics that demonstrate if your prediction for the experiment is correct. Build more inclusive products by leveraging audience segmentation strategies and ad-hoc post analysis to better understand the impact of changes on specific user groups. Determine which path is best for your team when deciding whether to go with a third-party A/B test framework or to build the A/B testing platform in-house. And finally, learn how to cultivate an experimentation-friendly culture within your team.
Leverage the A/B testing methodology to demonstrate the impact of changes on a product to your users, your key business metrics, and the way your team works together. After all, if you aren't measuring the impact of the changes you make, how will you know if you're truly making improvements?
This book will not teach you everything there is to know, but it will help you get more comfortable with the key components and concepts so you can kickstart your A/B testing journey. Whether you’re an engineer, manager, or product owner, this book is a starting point, overflowing with techniques and practical ways for you to approach the A/B testing process.
Specifically, we’ll cover these topics in the following chapters:
• Chapter 1: the rationale for running A/B tests.
• Chapter 2: the basic anatomy of an A/B test.
• Chapter 3: the various types of A/B tests.
• Chapter 4: the data requirements for running A/B tests and visualizing test results.
• Chapter 5: the factors to consider when building an A/B testing platform in-house versus a third-party solution.
• Chapter 6: the tactics to cultivate a test-friendly culture.
To illustrate these concepts, you’ll find references to a fictitious company called CableMax. The CableMax narrative is highly influenced by the experiences I already alluded to—my time at Comcast. The majority of the examples throughout this book are anchored on this experience of building an in-house solution to run experiments on a video product used by millions. When you’re ready to get started, you’ll have the perfect blueprint.
Скачать Practical A/B Testing: Creating Experimentation-Driven Products