Comparing the borderline regression standard setting method to a traditional method in an objective structured clinical examination

Mahat, Nur Ain and Ab Manan, Norhafizah and Bahari, Rafidah and Mohammed Abdul Qader, Amelah and Md Yusoff, Rohimah and Abdul Rahim, Maria Zalina (2025) Comparing the borderline regression standard setting method to a traditional method in an objective structured clinical examination. Education in Medicine Journal, 17 (3). pp. 29-41. E-ISSN 2180-1932

PDF - Published Version Restricted to Repository staff only Download (740kB) | Request a copy

Abstract

The Objective Structured Clinical Examination (OSCE) is regarded as an effective assessment method for evaluating the clinical skills and competencies of healthcare professionals. In recent years, there has been a growing interest in employing more data-driven approaches to standard setting in the OSCE; one such method is the borderline regression method (BRM). This study aims to compare the BRM with the traditional method to determine the passing score of the OSCE. This study, conducted at the University of Cyberjaya, analysed data from 131 medical students who took the OSCE in the Final Professional Examination. Two methods were employed to determine the passing score for each OSCE station: the traditional method, which utilised a 50% passing score, and the BRM method, which employed simple linear regression. In the BRM method, checklist scores were regressed onto global ratings, and the borderline global rating of two was used to determine the passing score. A margin of error was applied to assess the accuracy of the passing scores. For the traditional method, this was calculated as 1.96 × standard error. Of 131 candidates, the pass mark for BRM was 1.93 points higher than the traditional method (mean = 11.93 vs mean = 10.00) for all 20 stations. The margin of error was smaller for the passing mark using BRM compared to the traditional method, with a difference of 0.09 (0.39 vs 0.48), t = 1.96, p < 0.05. The BRM resulted in a higher pass mark with a smaller margin of error, while the traditional method had the opposite effect with a broader margin of error. The study suggests considering the adoption of BRM in OSCE in medical school, but the optimal method for high-stakes clinical examinations is still inconclusive.

Item Type:	Article (Journal)
Uncontrolled Keywords:	Standard setting, OSCE, Borderline regression method, Traditional method, Comparison
Subjects:	R Medicine > R Medicine (General) R Medicine > RT Nursing
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Nursing Kulliyyah of Nursing > Department of Professional Nursing Studies
Depositing User:	Nur Ain Mahat
Date Deposited:	08 Oct 2025 12:30
Last Modified:	08 Oct 2025 12:30
URI:	http://irep.iium.edu.my/id/eprint/123531

Actions (login required)

View Item