Summary of A/B Testing

Looking for the book?
We have the summary! Get the key insights in just 10 minutes.

A/B Testing book summary


8 Overall

9 Applicability

8 Innovation

7 Style


Dan Siroker – director of analytics for the 2008 Obama presidential campaign – and Pete Koomen present a breezy and important how-to report on methodical testing of online content. The authors present focused, practical tips in brief, clear chapters. Their guidance can help you shape any website to ensure that a higher percentage of online visitors become customers. getAbstract recommends this manual to those seeking to improve their websites, and to readers – including students, start-up entrepreneurs, investors and entrepreneurs – interested in data-driven decision making and the impact of cyberculture on business.

In this summary, you will learn

  • Why A/B testing is necessary,
  • What testing methods you can use, and
  • What benefits and challenges A/B testing presents.

About the Authors

Dan Siroker, CEO and co-founder of Optimizely, was director of analytics for the 2008 Obama campaign. Pete Koomen is president and co-founder of Optimizely.



The ABC’s of “A/B Testing”
President Barack Obama believes in “reason and facts and evidence and science and feedback,” so he had every aspect of his 2008 presidential campaign tested. His “‘new media’ team” tested the campaign’s electronic media, from Twitter to website design to the ...

Comment on this summary

  • Avatar
  • Avatar
    Guest 4 years ago
    Quote: "Sites become more effective when you remove elements – by shortening pages, simplifying forms or reducing the amount of text on a page." Earlier in the summary, the importance of defining the page's purpose is mentioned. When a site really has a purpose, it should not be cluttered with various elements, but focus on one, two or maybe three features. A cluttered website is often the result of a bad (or worse: missing) conception.
    A/B testing makes it easy to get rid of those: Make a test that hides or removes an element, and if the conversion and interaction doesn't go down, the element wasn't necessary.

More on this topic

Contained in Knowledge Pack:

  • Knowledge Pack
    Web Pages that Work
    The internet is full of ugly, uninformative websites, but you can make yours better, businesslike and beautiful

Customers who read this summary also read

More by category