Judging behaviour and rater errors: an application of the many-facet rasch model

Abu Kassim , Noor Lide (2011) Judging behaviour and rater errors: an application of the many-facet rasch model. GEMA Online Journal of Language Studies, 11 (3). pp. 179-197. ISSN 1675-8021

PDF (Judging behaviour and rater errors: an application of the Many-Facet Rasch Model ) - Published Version Restricted to Repository staff only Download (194kB) | Request a copy

Abstract

Of the potential sources of construct irrelevant variance or unwanted variability in performance assessment, those associated with raters have been found to be extensive, difficult to control, and impossible to eliminate. And as rater-related errors are non-trivial and threaten the validity of test results, it is necessary that these errors are accounted for and controlled in some way. This paper explains the different types of rater errors and illustrates how they can be identified using the Many-facet Rasch Model, as implemented by FACETS. It also demonstrates what these errors mean in terms of actual judging or rating behaviour and elucidates how they may affect the accuracy of estimation of performance. Rater errors that are explicated in this paper are those related to rater severity, restriction of range, central tendency, and internal consistency. As assessment and its procedures are central to student learning, matters related to valid and fair testing need to be taken seriously. It is hoped that with greater awareness of how we judge and a better understanding of how rater-related errors are introduced into the assessment process, we can be better raters and better teachers.

Item Type:	Article (Journal)
Additional Information:	778/13789
Uncontrolled Keywords:	judging, behaviour, rater
Subjects:	L Education > L Education (General) L Education > LB Theory and practice of education > LB2361 Curriculum
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Education
Depositing User:	Prof Dr Noor Lide Abu Kassim
Date Deposited:	10 Feb 2012 09:07
Last Modified:	03 Jul 2013 12:01
URI:	http://irep.iium.edu.my/id/eprint/13789

Actions (login required)

View Item