A/B Testing
by Philbert Tan
1. How to set up an A/B Testing?
1.1. Replace the element to be tested before the page loads
1.2. Redirect to another page
2. DO and DONT
2.1. DO
2.1.1. Know how long to run a test before giving up.
2.1.2. Show repeat visitors the same variations.
2.1.3. Make your A/B test consistent across the whole website.
2.2. DONT
2.2.1. Don't conclude too early
2.2.2. Don't surprise regular visitor
2.2.3. Don’t let your gut feeling overrule test results.
3. Pros & Cons
3.1. Pros
3.1.1. Fast
3.1.2. Test reality
3.1.3. Quantifiable
3.1.4. Accurate
3.2. Cons
3.2.1. Can Hurt Web Site Results
3.2.2. Missing the “Why”
3.2.3. Not Predictive
3.2.4. Needs Traffic