1. The Ultimate Guide To A/B Testing
1.1. What Is A/B Testing?
1.1.1. Comparing two versions, determining which version is better through experimentation and in the end select the version for real-world use.
1.1.1.1. What to test ??
1.1.1.1.1. Depend on user goals, example if your goals is to increase the number of sign up, than user might test the following, length of sign up form.
1.1.1.1.2. Other Test includes: 1. The call to action’s (i.e. the button’s) wording, size, color and placement, 2. Headline or product description, 3. Form’s length and types of fields, 4. Layout and style of website, 5. Product pricing and promotional offers, 6. Images on landing and product pages, 7. Amount of text on the page (short vs. long).
1.1.2. Do’s And Don’ts
1.1.2.1. DON’TS
1.1.2.1.1. When doing A/B testing, never ever wait to test the variation until after you’ve tested the control.
1.1.2.1.2. Don’t conclude too early.
1.1.2.1.3. Don’t surprise regular visitors.
1.1.2.1.4. Don’t let your gut feeling overrule test results.
1.1.2.2. DO’S
1.1.2.2.1. Know how long to run a test before giving up.
1.1.2.2.2. Show repeat visitors the same variations
1.1.2.2.3. Make your A/B test consistent across the whole website.
1.1.2.2.4. Do many test.
1.2. Pros and Cons pf A/B Testing
1.2.1. PROS:
1.2.1.1. It is very fast
1.2.1.2. User can obtain real results from real users doing real things. That means they are not using theory, estimates, forecasts, predictions, your Horoscope or Fairy cards to base decisions on.
1.2.1.3. Quantifiable: A/B web site testing provides actual numbers that can be compared, sliced and diced to evaluate results.
1.2.1.4. Accurate
1.2.2. CONS:
1.2.2.1. Can Hurt Web Site Results
1.2.2.2. Missing the “Why”
1.2.2.3. Not Predictive
1.2.2.4. Needs Traffic, In order to provide quick, consistent and reliable results, you’re going to need a pretty good amount of traffic to your web page to run an A/B test