Validity & Reliability

1. Test questions should correspond to what will be on the test

2. Content Validity Evidence

2.1. Only shows if the test looks good and not if the test items are written poorly

2.2. Not used to as a guarantee of a good test but more of a minimum requirement in determining the usefulness of the test

3. Predictive Validity Evidence

3.1. Determines how well a test will read future behaviors of test takers

3.2. Measures test takers on what the test will tell about the test takers after a period of time has gone by

3.3. Example: State Realtor Exam will allow the State to decide who can become a realtor

4. Review

4.1. Is test applicable for intended purpose?

4.2. Does test measure what is supposed to be measured?

4.3. Does test do what it was intended to do?

5. Concurrent Criterion related validity evidence

5.1. Deals with measures administered at the same time as the measure to be validated

5.2. Outcome is a numeric value; correlation coefficient

5.3. Correlation between the established test and the new test using test scores of each

5.4. Can determine advantages of using new test versus established test

6. Validity evidence

6.1. Does the test measure what it is suppose to measure?

6.2. Are test scores consistent?