Validity and Reliability

1. Reliability

1.1. Consistency of test given more than once.

1.2. A test is reliable if the scores are the same after taken over a period of time.

1.2.1. Helps in Placement decisions

1.2.2. Helps determine diffivulty level of instruction.

1.3. Estimate reliability

1.3.1. test and retest

1.3.2. compare scores

1.4. Alternate forms

1.4.1. Two forms of equalivant test

1.4.2. students can not memorize

2. Internal consistency

2.1. Test one question of a basic concept.

2.2. If results is correct we assume that similar questions will also be right.

3. Content Validity Evidence

3.1. Inspecting test questions

3.1.1. Task 1

3.1.2. Task 2

3.2. Looks valid

3.2.1. Call 1

3.2.2. Call 2

3.3. Should corresponds what the user wants to be covered

3.3.1. Meeting 1

3.3.2. Meeting 2

4. Criterion-related evidence

4.1. Scores from a test are correlated with an external criterion

4.2. Concurrent

4.2.1. Deals with measures to be validated

4.2.2. Compare an old test with a new test being given

4.3. Predictive Validity Evidence

4.3.1. A prediction of success

4.3.2. Examples: SAT's

5. Construct Validity Evidence

5.1. Information that corresponds with a theory.

5.1.1. Results corresponds to what you would expect.