Flashcards
6 Psychometric Testing - Test Construction
Cards in this deck (6)
- 1Psychometric testing - Criterion-keyed methodMethod focussed on the domain, or criterion required to be tested (e.g. numeracy, word skills); Best examples include MMPI (Hathaway & McKinley 1951), devised re psychiatric patients requiring help.
Problem of atheoretical basis; needs clear definition of the selected criterion;
Generalisability - the more specific the domain, the less likely it can be transported to other contexts - 2Psychometric testing - Factor-analytic methodExample is Cattell's 16PF.
Must identify items which relate to just one factor, or ambiguity arises.
A test involves number of items, related to a number of (measured) scales, hence requires a large sample for devising such a test to reduce the standard error;
Need to ensure differences identified really are a function of the test-takers, and not of the items - 3Psychometric testing - Item-analytic methodFocus on the item; generally uni-factorial tests developed; can help improve reliability and validity of longer, multi-factorial tests; but watch for "bloated specifics" (where several items appear to contribute to the validity of a given scale, but they are not independent, but all effectively measure the same thing.);
Tend to be context-specific, hence not very transportable. - 4Psychometric testing - Thurstone Scales methodUsed widely in assessing attitudes. Comprises statements concerning a given attitude, whose relevance is evaluated by panel of judges - must core whole range of potential attitudes. Can be affected by "social desirability" concerns, and implicitly imbued with personal values;
Also questionable re transportability. - 5Psychometric testing - Guttman Scales methodPredicated on the cumulative and hierarchical nature of ability.
Thus the items are graded, each subsequent item becoming more difficult. The assumption is that if you fail at a certain item, then your ability is limited up to that point, i.e. cannot achieve anything beyond that level (as it is of greater difficulty.) - 6Psychometric testing - IRT, Item Response TheoryThis is based on each item's difficulty being equated to the ability of the test-taker, such that the level of the candidate's ability is determined by the items chosen to be answered (on the basis of their being correctly answered!) THis system is also cumulative and hierarchical, like Guttman.
i.e. "The score obtained in an IRT test is a function of the test-taker's response and the characteristics of the item" (Hogan 2003)
Information
- Description
- D842 Flashcards on 6 Psychometric Testing - Test Construction, created by mifrrole on 16/04/2013.
- Created by
- mifrrole
- Views
- 76
- Tags
- Rating