Validity

Validity

1. content

   • how an individual performs on a domain of tasks that the assessment should represent
   • how does it emphasize the most important content
   • table of specifications
     • procedure in constructing achievement tests to specify what an assessment should measure
     • two-way chart
   • content considerations on large/state assessments are based on alignment studies

2. construct

   • test measures intended hypothetical construct
     • evaluate cognitive processes used by students
     • evaluate relationships of scores with other measures
   • two questions central to validation
     • does the assessment adequately represent the intended construct
     • is performance influenced by factors that are irrelevant to construct

3. assessment-criterion relationship

   • compare with another measure of performance obtained at same time
     • concurrent-validation study
   • compare assessment results with other measures obtained at later date
     • predictive validation study
   • graphical presentation
     • scatter plot
     • expectancy table
   • correlation coefficient
     • numerical summary of degree of relationship between set of scores

4. Consequences

   • effects of use of assessments on teachers/students
     • intended positive effects
     • possible unintended negative effects
   • considering questions
     • Do tasks match learning objectives
     • Is there a reason to believe that student study harder in preparation for the assessment
     • Does assessment constrain focus of students' study
     • Does the assessment encourage or discourage exploration and creative modes of expression
   • evaluate effects of use of assessment results on teachers/students
   • intended positive effects need to be evaluated