3 Reliability and Validity of Assessment Tools - Reliability

Description

D842 Flashcards on 3 Reliability and Validity of Assessment Tools - Reliability, created by mifrrole on 13/04/2013.
mifrrole
Flashcards by mifrrole, updated more than 1 year ago
mifrrole
Created by mifrrole almost 11 years ago
34
0

Resource summary

Question Answer
Procedural aspects affecting Reliability Conditions under which a test is taken; Inconsistent test administration practices; Poor test-scoring practices: Inappropriate norm groups applied; Internal state of test-taker: Experience level of test-taker.
Reliability - Stability of results of tests Test-retest stability (i.e. repeating test - how long? generally >= 3 months); Carry-over effects (questions and responses remembered); Practice Effects (methodology honed); Attrition (failure to attend second sitting)
Reliability - Consistency 1 (of results of tests) Split-half testing (either sequentially, or by odd/even numbered questions); Spearman-Brown formula to correct for error of artificially reduced reliability, due to resulting lower effective sampling size
Reliability - Consistency 2 (of results of tests) Kuder-Richardson Reliability aka "Coefficient Alpha". Assesses inter-item consistency by considering: a) content sampling adequacy, & b) heterogeneity of domain being sampled
Reliability - Equivalence of results (parallel form) 1 Equivalence between different versions of the same test. Danger of "Bloated Specifics" (Cartell, 1973) - reduced criterion coverage by manipulation having several items of essentially same theme, giving artificially raised impression of reliability - so now less valid!
Reliability - Equivalence of results (parallel form) 2: other considerations Parallel versions of same test today facilitated by computer cloning. Can be useful, because in "milk-round" unfair advantages eliminated, as everyone will have done several! Also note equivalence and "adverse impact", discrimination against any particular population categories. (e.g. blacks and cognitive ability tests.)
Show full summary Hide full summary

Similar

7 Ability Tests
mifrrole
2 Job Analysis - Worker oriented Analysis
mifrrole
4 - Curriculum Vitae
mifrrole
3 Reliability & Validity of Assessment Tools - Validity
mifrrole
9 Work Samples
mifrrole
5 New Developments
mifrrole
2 Job analysis - Work-oriented analysis
mifrrole
2 Job Analysis - Accuracy and Stability
mifrrole
3 Meta-Analysis re Validity Generalisation
mifrrole
2 Job Analysis - the future
mifrrole
4 Application Forms
mifrrole