1. Levels of Evidence
1.1. Level I
1.1.1. meta-analysis
1.1.2. randomized control trials
1.1.3. systematic reviews
1.2. Level II
1.2.1. cohort studies
1.3. Level III
1.3.1. case-controlled studies
1.4. Level IV
1.4.1. case series
1.4.2. case report
1.5. Level V
1.5.1. editorials
1.5.2. expert opinion
1.5.3. literature review
2. Biases
2.1. publication bias (systematic review)
2.2. lack of universal definitions and consistent measures (meta-analysis)
2.3. participants know what group they are in, dropouts, contamination, diff setting, inappropriate generalization, feasibility (randomized controlled trial)
2.4. selection bias, attrition, inconsistent data collection (cohort study)
2.5. recall/memory bias (case control study)
3. Variables
3.1. Dependent (DV)
3.1.1. outcome
3.1.2. results
3.1.3. criterion
3.2. Independent (IV)
3.2.1. cause of outcome
3.2.2. can be changed
3.2.3. predictor
4. What to consider
4.1. Challenges in study design
4.2. Internal validity
4.2.1. did IV cause effect?
4.2.2. bias?
4.3. External validity
4.3.1. generalizability
4.3.2. interested in population
4.3.3. large samples
5. Guiding Questions
5.1. Internal validity
5.1.1. was the statistical approach appropriate to answer the question?
5.1.2. what were the results? are the finding statistically significant?
5.1.3. were the conclusions supported by the study findings?
5.2. External validity
5.2.1. was the sampling plan appropriate?
5.2.2. was the sample size adequate?
5.2.3. nonresponse/dropout
5.3. Clinical importance
5.3.1. are the finding clinically significant?
5.3.2. how large were the treatment effects or effect size?
5.3.3. does the evidence pertain to my clinical situation?
5.3.4. can the therapeutic intervention be implemented in my clinical setting?