Twelve steps for effective Test development

Twelve steps for effective Test development

1. Step 1: Overall Plan

   • Puts the project into a realistic timeline
     • Emphasizes test quality
     • Control Problems
   • testing program must be made prior to beginning formal test development activities
     • Systematic guiad for the test activities
       • Mayor sources of validity

2. Setp 2: Content definition

   • What content is to be tested
     • Various methods relazed to purpose of assesment
   • Content defining methods vary in rigor, depending on the purpose of the test,
   • Delimitation of construct

3. Step 3: Test Specifications

   • Operational definitions of content
     • Type of testing format.
       • The total of test items

4. Step 4: Item Development

   • Development of effective test items
     • What formats use to propose examination
       • choice of item format is a major source of validity evidence for the test.

5. Step 5: Test design and assembly

   • Designing and creating test forms; selecting items for specified test forms;
     • blueprint; pretesting considerations

6. Step 6: Test production

   • Publishing activities; printing or CBT packaging
     • validity issues evidence

7. STEP 7: TEST ADMINISTRATION

   • Validity issues concerned with standardization
     • ADA issues;
     • proctoring; security issues; timing issues

8. STEP 8: SCORING TESTS RESPONSES

   • Validity issues: quality control; key validation; item analysis

9. STEP 9: PASSING SCORES

   • Establishing defensible passing scores; relative vs. absolute
   • validity issues concerning cut scores;
     • standards: maintaining constancy of score scale

10. STEP 10: REPORTING TEST RESULTS

    • Validity issues: accuracy, quality control; timely;
    • meaningful; misuse issues; challenges; retakes

11. STEP 11: ITEM BANKING

    • Security issues; usefulness, flexibility; principles for effective item banking

12. STEP 12: TEST TECHNICAL REPORT

    • Systematic, thorough, detailed documentation of validity