Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test

Jusoh, Zailani and Zubairi, Ainol Madziah and Badrasawi, Kamal J I (2018) Validity evidence using expert judgment: a study of using item congruence involving expert judgements for evidence for validity of a reading test. Al-Shajarah, Special Issue: Education. pp. 307-320. ISSN 1394-6870

	PDF - Published Version Restricted to Registered users only Download (7MB) | Request a copy
Preview	PDF (SCOPUS) - Supplemental Material Download (603kB) | Preview

Abstract

This study demonstrates the use of the Item Objective Congruence Method (IOC) for a content validation procedure to evaluate the congruence between reading test items constructed and the reading sub-skills they were intended to measure. The IOC allows for quantification of the content validity evidence of a test or an instrument. In this study, experts were asked to rate 96 reading comprehension test items against the sub-skills that the items were intended to measure. In line with the concept of justice in Islam, it is important that the evidence of justice is demonstrated. Using ten English language experts who were also experienced test writers, the study found different degrees of agreement between the experts in terms of what some of the items were supposed to measure. Items that showed considerable incongruence are those that test multiple subskills. Whereas, items that had high degree of congruence are those that clearly test a single subskill.

Item Type:	Article (Journal)
Additional Information:	780/69103
Uncontrolled Keywords:	Expert Judgement, Validity, Just, Test Construction
Subjects:	L Education > L Education (General)
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Education
Depositing User:	Dr. K J Badrasawi
Date Deposited:	03 Jan 2019 12:24
Last Modified:	01 Feb 2019 11:25
URI:	http://irep.iium.edu.my/id/eprint/69103

Actions (login required)

View Item