Assessments

1. Reliability

2. Defined: Consistency to which it yields the same rank for individuals who take the test more than once (Kubiszyn, 2010).

3. Does the test yield the same or similar score rankings consistently?

4. Test-Retest or Stability- method of estimating reliability that is exactly what its name implies (Kubiszyn, 2010).

5. Alternate Forms or Equivalence- these forms can be used to obtain an estimate of the relaibility of the scores from the tests (Kubiszyn, 2010).

6. Internal Consistency- items should be consistent with each other and the tests should be internally consistent.

7. Kuder-Richardson methods: Measure the extent to which items within one form in the test have in common.

8. Split-half methods: each item assigned to one half or the other

9. Reliability Coefficients

10. Principle 1: Group variability affects the size of the reliability coefficient. Higher coefficients result from homogenous groups (Kubiszyn, 2010).

11. Principal 2: Scoring Reliability limits test score reliability. If tests are scored unreliably, erro is introduced that will limit the reliability of the test scores (Kubiszyn, 2010).

12. Principal 3: All other factors being equal, the more items included in a test, the higher the reliability of the scores (Kubiszyn, 2010).

13. Principal 4: Reliability of test scores tends to decrease as tests become too easy or too difficult (Kubiszyn, 2010).

14. Validity

15. Defined:demonstrating that it measures what it says it measures (Kubiszyn, 2010).

16. Does the test measure what it is supposed to?

17. Content Validity Evidence-established by inspecting test questions to see if they correspond to what the user decides should be covered by the test (Kubiszyn, 2010).

18. Criterion-Related Validity Evidence-Scores are correlated with an external criterion.

19. Concurrent Criterion-related validity evidence-examples, IQ tests

20. Predictive validity evidence- examples, SAT's

21. Construct Validity Evidence: Has construct validity if its relationship to other information correspons well with a theory (Kubiszyn, 2010).

22. Validity Coefficients

23. Content Validity Evidence: comparing test items with instructional objectives to determine whether the items match or measure the objectives(Kubiszyn, 2010).

24. Concurrent And Predictive Validity Evidence: require the correlation of a predictor or concurrent measure with criterion measure (Kubiszyn, 2010).