Validity and Reliability
by Janet DeMarco
1. Criterion-Related Validity
1.1. Concurrent; a combination of two tests that correlate to each other. Comparing the two scores and calculating the coefficient. If the same student shows the same high correlation, then the test is appropriate.
2. Overall Validity
2.1. Coefficients should relate to relevance and reliability of criterion and standard tests.
3. Reliability
3.1. Deals with consistency. In viewing reliability of tests we look to make sure a test is dependable, stable, and reliable even after the test is given in a repeat testing. Many different methods are used to measure the reliability of a test.
4. Test-Retest Stability
4.1. When a test is given more than once and the relationships between them are the same. The downfall on this method in a classroom will be a student may use memory skills on the second test which will not make this method as reliable as it states. Alternate forms or equivalence testing is time consuming; it is timely to develop one test, but with this method two tests need to be developed. This method will alleviate the memory use a student may use with the test-retest method. Using this method and comparing scores should be close to each testing score or the method will not be as reliable.
5. Internal Consistency
5.1. Giving a single test of two shorter alternative forms such as, odd-even reliability or split-half. This method will have an advantage of not allowing memory or practice to final scoring, but it underestimates the effect of a full length alternative form test..
6. Overall Validity and Reliability
6.1. Utilization of both validity and reliability will give different results an instructor may use to make determinations on progress of a student learning outcomes. It is important for an instructor to incorporate different methods to compare and get a final grade outlook for each student.
7. Validity
7.1. Demonstrates that it is to measure what it says it will measure.
8. Content Validity
8.1. A test question that corresponds to a particular topic and meets instructional objectives such as, a standardized test.
9. Prediction Validity
9.1. A pretest to ensure and predict success in learning.
10. Construct Validity
10.1. Focuses on a specific area within a subject.