Using Rasch analysis for validation of knowledge and perception of orthopedic workplace‑based assessment among postgraduate orthopedic trainees’ questionnaire

Abdul Majid, Ahmad Anas and Khalid, Kamarul Ariffin (2025) Using Rasch analysis for validation of knowledge and perception of orthopedic workplace‑based assessment among postgraduate orthopedic trainees’ questionnaire. Journal of Pharmacy and Bioallied Sciences, 16 (4). pp. 126-129. ISSN 0976-4879 E-ISSN 0975-7406

PDF (Article) - Published Version Restricted to Registered users only Download (598kB) | Request a copy

Abstract

Introduction/Background: Workplace-based assessment (WPBA) was formally introduced into orthopedic postgraduate training in Malaysia as of December 2022. Understanding users' knowledge and perception (KAP) of WPBA is essential for ensuring its effective implementation. A systematic review is needed to evaluate whether WPBA is meeting educational expectations. Objective: This study aimed to validate a questionnaire designed to assess the knowledge and perception of WPBA among postgraduate orthopedic trainees. Materials and Methods: A pilot study was conducted from Aug 1, 2022 to May 31, 2023 involving a 28-item questionnaire that had undergone thorough face and content validation. The questionnaire was distributed to orthopedic postgraduate trainees at the Department of Orthopaedics, Traumatology and Rehabilitation, Kulliyyah of Medicine, International Islamic University Malaysia (IIUM). Rasch analysis was performed to evaluate the psychometric properties of the instrument. Results: The Rasch analysis revealed a person reliability index of 0.93 and a separation index of 3.62, while the item reliability index was 0.99 with a separation index of 8.32. The mean infit and outfit mean square (MNSQ) values were 0.99 and 0.96 respectively, with Z-standard (Z-STD) values of 0.24 and ‑0.35. Several misfitting items fell outside the acceptable range (0.6–1.4) and were subsequently removed from the questionnaire. Conclusions: The validation and reliability testing confirmed that the orthopedic WPBA KAP questionnaire recently developed is both reliable and valid for assessing postgraduate trainees' understanding of WPBA.

Item Type:	Article (Journal)
Uncontrolled Keywords:	Item reliability index, mean infit mean square, orthopedic, person reliability index, rasch analysis, workplace‑based assessment
Subjects:	R Medicine > R Medicine (General) R Medicine > RD Surgery > RD701 Orthopedics
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Medicine Kulliyyah of Medicine > Department of Department of Orthopaedics, Traumatology & Rehabilitation
Depositing User:	Assoc. Prof. Dr. Kamarul Ariffin Khalid
Date Deposited:	07 Apr 2025 07:11
Last Modified:	07 Apr 2025 07:11
URI:	http://irep.iium.edu.my/id/eprint/120463

Actions (login required)

View Item