Common item linking procedure as a solution for deficiency in judging plan and double rating of essays

Abu Kassim, Noor Lide (2020) Common item linking procedure as a solution for deficiency in judging plan and double rating of essays. In: Malaysian International Convention on Education Research & Management (MICER 2020), 25th-26th August 2020, Kuala Lumpur. (Unpublished)

PDF - Published Version Restricted to Registered users only Download (753kB) | Request a copy

Abstract

The purpose of this study was to explore the use of a common item linking procedure using multiple-choice grammar items to link subgroups of examinees’ essays scored by independent pairs of raters. This procedure was tested as a means to provide a more equitable way to address deficiencies in essay judging plans as well as to evaluate the possibility of using a single rating for valid assessment of students’ essays. A total of 2449 examinees’ essay ratings, scored by 40 raters, and their responses to 40 MCQ grammar items were used as the data set in this study. The data were analyzed using FACETS version 3.48. The findings showed that the common item linking procedure using MCQ items provided not only the necessary links but also strong evidence that single ratings can yield similar measures as double ratings with these links in place. The use of this procedure can help resolve some of the issues surrounding essay scoring, particularly in large scale testing. The common item linking procedure has considerable promise as it has the potential to resolve some practical issues, such as time constraints, and the use of a large number of raters; as well as more serious validity issues such as rater errors and rater drift.

Item Type:	Conference or Workshop Item (Invited Papers)
Additional Information:	778/86534 - Online via Zoom
Uncontrolled Keywords:	linking procedure, deficiency. essay writing
Subjects:	L Education > LB Theory and practice of education L Education > LB Theory and practice of education > LB2300 Higher Education
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Education Kulliyyah of Education > Department of Language & Literacy
Depositing User:	Prof Dr Noor Lide Abu Kassim
Date Deposited:	22 Dec 2020 14:44
Last Modified:	24 Mar 2021 11:00
URI:	http://irep.iium.edu.my/id/eprint/86534

Actions (login required)

View Item