NCI evalution: assessment of higher order thinking skills via short free text answer

Lajis, Adidah and Nasir, Haidawati and Abdul Aziz, Normaziah (2020) NCI evalution: assessment of higher order thinking skills via short free text answer. In: 2019 IEEE 6th International Conference on Smart Instrumentation, Measurement and Applications (ICSIMA 2019), 27 - 29 Aug 2019, Kuala Lumpur, Malaysia.

	PDF (with front cover) - Published Version Restricted to Registered users only Download (355kB) | Request a copy
	PDF (SCOPUS) - Supplemental Material Restricted to Registered users only Download (235kB) | Request a copy
	PDF (paper only no front cover version) - Published Version Restricted to Registered users only Download (187kB) | Request a copy

Abstract

NCI a hybrid approach of Natural Language Processing (NLP), Convolutional Neural Network (CNN) and Information Theory are applied to assess higher order thinking skills via short free text answer. Data of students' examination scripts are collected from 3 domains namely Information Technology, Engineering and Management with a total of 479 answer scripts. All data are of tertiary level examinations. These answer text are firstly, processed by applying NLP. Next, the pattern of known-information is generated by applying CNN-seq concept and finally based on the pattern the amount of known-information is computed by applying information theory approach. Result shows that the proposed techniques achieved an excellent achievement of 0.89 and above for all domains and all level of higher order thinking skills. LSA based testing achieved from 0.47 to 0.83 agreement. This result supports that the proposed hybrid technique can improve automated short free text assessment in a given scope of domain and competency level.

Item Type:	Conference or Workshop Item (Plenary Papers)
Additional Information:	5505/80429
Uncontrolled Keywords:	free text answer, higher order thinking skills, assessment, cognitive competency, assisted assessment
Subjects:	T Technology > T Technology (General)
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Information and Communication Technology Kulliyyah of Information and Communication Technology
Depositing User:	Dr. Normaziah Abdul Aziz
Date Deposited:	12 May 2020 09:25
Last Modified:	28 Jan 2021 07:48
URI:	http://irep.iium.edu.my/id/eprint/80429

Actions (login required)

View Item