1. Reliability
1.1. " A test (or any measuring instrument) is reliable if it consistently yields the same, or nearly the same,ranks over repeated administrations during which we would not expect the trait being measured to have changed." (Kubiszyn 341)
1.1.1. Establish checkpoints
1.1.2. Acquire team resources for stage
1.1.3. Conduct stage kick-off meeting
1.2. "If there are two equivalent forms of a test, these forms can be used to obtain an estimate of the reliability of the scores from the test." (Kubiszyn 343)
1.2.1. Determine Frequency of Meetings
1.2.2. Schedule Meetings
1.2.3. Brief Project Board
1.2.4. Prepare Meetings
1.2.5. Conduct Meetings
1.2.6. Follow-up Meeting
1.3. "Internal consistency estimates of reliability fall into two general categories: split-half or odd–even estimates and item–total correlations, such as the Kuder –Richardson (KR) proce- dure. These estimates should be used only when the test measures a single or unitary trait." (Kubiszyn 349) Kubiszyn, Tom. Educational Testing and Measurement: Classroom Application and Practice, 9th Edition. John Wiley & Sons, 102009. <vbk:9780470571880#page(349)>.
1.3.1. Schedule Quality Review Meeting
1.3.2. Prepare for Quality Review Meeting
1.3.3. Conduct Quality Review Meeting
1.3.4. Follow-up Quality Review Meeting
2. Validity
2.1. Thoroughly inspect the test questions to make sure that test corresponds with desired content
2.1.1. Recruit Project Sponsor
2.1.2. Recruit Project Manager
2.1.3. Review Related Projects and Lessons Learned
2.1.4. Prepare Project Initiation Plan
2.1.5. Brief the Initial Project Team
2.1.6. Review Project Kick-off Plans and Presentation Map
2.1.7. Hold Project Kick-off Meeting
2.2. Does the test measure the instructional objectives? (Kubiszyn 330
2.2.1. Establish Project Objective
2.2.2. Establish Project Scope
2.2.3. Map Requirements
2.2.4. Map Solution
2.2.5. Map Training Requirement
2.2.6. Review Project Scope
2.3. "In establishing criterion-related validity evidence, scores from a test are correlated with an external criterion. There are two types of criterion-related validity evidence: concurrent and predictive. (Kubiszyn 330)
2.3.1. Determine Project Approach, Stages and Steps
2.3.2. Estimate Project Duration
2.3.3. Establish Resource Requirements
2.3.4. Prepare Project Schedule and Budget
2.3.5. Prepare Work breakdown structure
2.3.6. Document Success Criteria
2.3.7. Review Project Schedule