1. minimized experiment
1.1. Ask primary question
1.1.1. What are we trying to prove by building XX?
1.1.2. What do we need to know before we are confident that XX is the right thing to build?
1.2. Do research
1.2.1. analysis
1.2.2. deduction
1.3. questions on primary question
1.3.1. brain storm
1.3.2. questions
1.3.3. review
1.3.4. vote for hypothesis
1.3.4.1. "scariest" questions
1.4. ideas
1.4.1. brain storm
1.4.2. focused on answering important questions
1.4.3. Construct a hypothesis
1.4.4. Design mearement
1.5. implement
1.5.1. small group
1.5.2. chosen and prove
1.5.3. mini hack
1.6. present the findings from hack
1.6.1. stop hacking
1.6.2. try something else
1.6.3. continue and adopt the option
1.7. Analyze data
1.7.1. iteration
1.7.2. Have a set of concept options
1.7.3. Have a prioritised set of features
1.7.4. Identify plans for next iteration
1.8. draw conclusions
1.8.1. User behaviour track tools
1.8.1.1. google analytics
1.8.1.2. omniture
1.8.1.3. Elktrack
1.8.1.3.1. logstash
1.8.1.3.2. elasticsearch
1.8.1.3.3. kibana
1.9. Report results
2. A/B testing
2.1. popular tools
2.1.1. optimizely
2.1.2. maxymiser
2.1.3. Google Website Optimizer
2.1.4. Visual Website Optimizer
2.1.5. https://vwo.com
2.2. basic princeple
2.2.1. focus on minimized test purpose
2.2.1.1. goal
2.2.1.2. variables
2.2.1.3. test
2.2.1.4. example if I want to testing the conversion of a button
2.2.1.4.1. location of the button
2.2.1.4.2. text on the button
2.2.1.4.3. color and space on and arround the button
2.2.2. test things might have big impact
2.2.3. testing time
2.2.4. not restrict to two testing group
2.2.5. shunt
2.2.5.1. backend
2.2.5.2. frontend
2.2.5.2.1. cookieID
2.2.6. unique visitor
2.2.7. sample size
2.3. diaplay
2.3.1. css control
2.3.2. ajax/pjax
2.3.3. redirect
2.4. data collection and analysis
2.4.1. user behaivior on test area
2.4.1.1. which verision A or B
2.4.1.2. position
2.4.1.3. time
2.4.1.4. url