Stages of test development

Stages of test development

1. formed by

   • Stating the problem
     • is
       • What it is one wants to know with the test?
       • What is the purpose?
   • Writing specifications for the test
     • includes
       • Content
         • is the
           • Potential of any test versions
             • should specify
               • Operations
               • Types of text
               • Addressees of texts
               • Lenght of text
               • Topics
               • Readability
               • Structural range
               • Vocabulary range
               • Dialect, accent, style
               • Speed of processing
       • Structure, timing, medium/technique, techniques
         • specified by
           • Test structure
           • Number of items
           • Number of passages
           • Medium/channel
           • Timing
           • Techniques
       • Critical levels of performance
         • to
           • Measure different levels of success
       • Scoring procedures
         • is
           • How they will achieve reliability and validity?
   • Writing and moderating items
     • process is
       • Sampling
         • which is
           • Choose wisely from the area of content
       • Writing items
         • with
           • Specifications
           • Key
             • is
               • Correct response
       • Moderating items
         • is
           • Scrutiny of proposed items
             • to
               • Find weakness and solve them
   • Informal trialling of items on native speakers
     • must be
       • Similar to the test-takers
         • they
           • Provide information to revise items
   • Trialling on the test on a group of non-native speakers
     • in this
       • Checking problems on administration and scoring
   • Analysis of results of the trial
     • divided in
       • Statistical
         • it will
           • Reveal qualities
             • of
               • Whole test
               • Individual items
       • Qualitative
         • it
           • Examines responses
             • to
               • Discover misinterpretations
   • Calibration of scales
     • means
       • Collecting performance samples
         • to
           • Assign a relevant scale
   • Validation
     • is
       • Essential
   • Writing handbooks for test-takers, users and staff
     • contains
       • Rationale of the test
       • Test's development and validation
       • Description of the test
       • Sample items or test
       • Advice on preparation
       • Explanation of test scores
       • Training materials
       • Administration details
   • Training staff
     • includes
       • Scorers
       • Computer operators
       • Invigilators
       • Interviewers