Rasch modeling of accuracy and confidence measures from cognitive tests

Journal article


Paek, Insu, Lee, Jihyun and Wilson, Mark. (2013). Rasch modeling of accuracy and confidence measures from cognitive tests. Journal of Applied Measurement. 14(3), pp. 232 - 248.
AuthorsPaek, Insu, Lee, Jihyun and Wilson, Mark
Abstract

The use of IRT models has not been rigorously applied in studies of the relationship between test-takers' confidence and accuracy. This study applied the Rasch measurement models to investigate the relationship between test-takers' confidence and accuracy on English proficiency tests, proposing potentially useful measures of under or overconfidence. The Rasch approach provided the scaffolding to formulate indices that can assess the discrepancy between confidence and accuracy at the item or total test level, as well as at particular ability levels locally. In addition, a "disattenuated" measure of association between accuracy and confidence, which takes measurement error into account, was obtained through a multidimensional Rasch modeling of the two constructs where the latent variance-covariance structure is directly estimated from the data. The results indicate that the participants tend to show overconfidence bias in their own cognitive abilities.

Year2013
JournalJournal of Applied Measurement
Journal citation14 (3), pp. 232 - 248
ISSN1529-7713
Page range232 - 248
Research GroupInstitute for Positive Psychology and Education
Publisher's version
File Access Level
Controlled
Permalink -

https://acuresearchbank.acu.edu.au/item/87xq0/rasch-modeling-of-accuracy-and-confidence-measures-from-cognitive-tests

Restricted files

Publisher's version

  • 52
    total views
  • 0
    total downloads
  • 4
    views this month
  • 0
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as