Validity and Reliability

1. What is it that you are measuring?

1.1. "A valid test measures what it is supposed to."

2. Two types of Criterion-related validity evidence.

2.1. Concurrent

2.1.1. "Concurrent validity evidence is determined by correlating test scores with a criterion measure collected at the same time"

2.2. Predictive

2.2.1. "Predictive validity evidence is determined by correlating test scores with a criterion measure collected after a period of time has passed."

3. Reliability

3.1. "A reliable test will yield stable scores over repeated administrations, assuming the trait being measured has not changed."

4. 4 types of principles

4.1. Group variability

4.2. Scoring reliability

4.3. Test length

4.4. Item difficulty

5. References Kubiszyn, T. & Borich, G. (2010). Educational testing & measurement: Classroom application and practice (9th ed.). John Wiley & Sons, Inc., Hoboken, NJ.