Compare and contrast Norm referenced vs criterion referenced measurement.
15 marks · directive: Compare and contrast
The core of a good answer
Norm-referenced measurement interprets a score by a person's rank relative to a reference group, while criterion-referenced measurement interprets it against a defined body of content or a performance standard (mastery or a cut score); they differ in purpose, item selection and reporting, but both need valid tests and the same test can sometimes support both interpretations.
An outline written by upsc.help, not an official UPSC answer; every fact checked by a separate review. How we work
What the question asks
Define both (Glaser, 1963), set out the differences on several dimensions, note the similarities, and say when each is appropriate. A table-like comparison works well for 15 marks.
Answer outline
Introduction
Robert Glaser (1963) coined both terms. The difference lies in the frame of reference used to interpret a score: other people (norms) or a criterion (a defined domain or standard).
Norm-referenced measurement
- Purpose: to rank and select, by spreading individuals out.
- Scores reported as percentile ranks or as IQ-type scores (median set at 100), relative to a normative sample.
- Items chosen to separate the strongest from the weakest test takers; an item everyone answers correctly does not differentiate and is of little use.
- Depends on the reference group, which may not represent the current population of interest.
- Examples: IQ tests such as the WISC, and college entrance examinations such as the SAT and GRE.
Criterion-referenced measurement
- Purpose: to find out whether a person has mastered specified content or skills.
- Scores usually reported as pass or fail against a cut score, though not every criterion-referenced test has one.
- Items are those answered correctly by students who know the specific material, whatever the spread of scores.
- Examples: driving tests, citizenship tests and most tests and quizzes written by school teachers.
Points of contrast
- Interpretation: relative versus absolute.
- Use: selection and diagnosis of relative standing versus certification, diagnosis of learning gaps and programme evaluation.
Similarities
- Both still need validity: norm-referencing by itself does not ensure that a test is valid.
- Some tests report both, for example the ACT gives a ranking and also the level considered necessary for likely success in college.
Conclusion
Norm-referenced measurement answers 'how does this person compare?', criterion-referenced answers 'what can this person do?'; competency-based education increasingly needs the latter, while selection still relies on the former.
Examples and data to cite
- Driving tests and citizenship tests are criterion-referenced: they check whether a standard is met.
- The ACT reports both a ranking and a level associated with likely college success.
Facts to remember
- Glaser (1963), 'Instructional technology and the measurement of learning outcomes', introduced the two terms.
- Norm-referenced tests favour items that separate the strongest from the weakest test takers.
- IQ tests are norm-referenced: they rank test takers against a population median set at 100.