1. Validity
1.1. Types of Validity Evidence
1.1.1. Content Validity Evidence
1.1.1.1. Established by inspecting questions to see whether they correspond to what the user decides should be covered on the test.
1.1.1.2. Do the test items match and measure the objectives?
1.1.2. Criterion-Related Validity Evidence
1.1.2.1. Concurrent Criterion-Related Validity Evidence
1.1.2.1.1. How well does performance on the new test match performance on an established test?
1.1.2.2. Predictive Validity Evidence
1.1.2.2.1. Correlate scores from the new test with a measure of some future performance.
1.1.3. Construct Validity Evidence
1.1.4. Interpreting Validity Evidence
1.1.4.1. The adequacy of validity evidence depends on both the strength of the validity coefficient and the purpose of the test.
1.1.4.2. Group variability affects the strength of the validity evidence.
1.1.4.3. Validity coefficients should be considered in terms of the relevance and reliability of the criterion or standard.
2. Reliability
2.1. Three basic methods of estimating reliability.
2.1.1. Test-Retest or Stability
2.1.2. Alternative Forms or Equivalence
2.1.3. Internal Consistency
2.1.3.1. Two approaches to determining a test's internal consistency.