Stages of test development

Stages of test development

1. 8. Validation

   • the final version of the test can be validated

2. 2. Writing specifications for the test

   • (i) Content
     • Refers to the entire potential content of any number of versions
       • Operation
         • the tasks that cadidates have to be able to carry out
       • Types of text
         • They might include letters, forms, etc.
       • Vocabulary range
       • Topics
         • may be specified
       • Addressees of texts
         • The kinds of people that the candidate is expected to be able to write or speak
       • Structural range
         • List of structure which may occur in texts
       • Lenght of text
         • of passages in which items are served
       • Speed of processing
         • The number of words to read per minute
       • Readability
         • Specified a range of ri
       • Dialect, accent and
         • The ones tesk takers are meant to understand
   • (ii) Structure, timing, medium/channel amd techniques
     • The following should be specified
       • Test structure
         • what section of tests will be tasted
       • Number of items
         • in total in the various section
       • Medium/channel
         • Paper and pencil, ect.
       • Number of passages
         • number of items assosiated
       • Timing
         • for each section
       • Techniques
         • what techniques will be used
   • (iii) Criterial levels of performance
     • The required levels of performance
       • for different levels of success should be specified
         • to demostrate master, 80 percent of the items
   • (iv) Scoring procedures
     • these are always important
       • particulary so where scoring will be subjective
         • they should be clear as how they will achieve high reliability and valid scoring

3. 7. Calibration of scales

   • Collecting samples of performance
     • which cover the full range of scales

4. 5. Trialling of the test in non native speakers

   • The ones that survive, should be test for non-native speakers

5. 6. Analysis of results of the triall

   • a final selection can be based on the results
     • Two kinds of analysis
       • Statistical
       • Qualitative

6. 9. Writing handbooks for test takers, test users and staff

   • Handbooks may contain
     • the rationale for the test
     • sample items
     • Details of the administration

7. 4. Informal trialing on native speakers

   • Items that were through moderation
     • Should be presented in an exam to native speakers

8. 3. Writing and moderating items

   • (iii) Moderating items
     • scrutiny of proposed of proposed items
       • by at least two colleaches
   • Sampling
     • the important is choose widely
       • do not concentrate in the elements easy to test
   • (ii) Writing items
     • Items should alwarys be written in specific location

9. 1 Stating the problem

   • The essential first step is
     • Make oneself clear about one wants to know
       • And for what purpose
         • Once the problem is clear
           • Steps can be taken to solve it

10. 10. Training staff

    • All staff who is involved in the test process should be trained

11. Vanesa Cerda Treviño Gpo: i45