Malay manuscripts transliteration using statistical machine translation (SMT)

Abdul Razak, Sitti Munirah and Abu Seman, Muhamad Sadry and Wan Mamat, Wan Ali @ Wan Yusoff and Mohammad Noor, Noor Hasrul Nizan (2020) Malay manuscripts transliteration using statistical machine translation (SMT). In: 2019 1st International Conference on Artificial Intelligence and Data Sciences (AiDAS), 19 Sept 2019, Ipoh, Perak.

	PDF - Published Version Restricted to Registered users only Download (1MB) | Request a copy
	PDF (SCOPUS) - Supplemental Material Restricted to Registered users only Download (221kB) | Request a copy

Abstract

Natural Language Processing (NLP) is a vital field of artificial intelligence that automates the study of human language. However for Malay manuscripts (MM) written in old jawi, its exposure on such field is limited. Besides, most of the studies related to MM studies and NLP were focused on rule based or rule based machine transliteration (RBMT). Hence the objective of this study is to propose a statistical approach for old jawi to modern jawi transliteration of Malay manuscript contents using Phrase Based Statistical Machine Translation (PBSMT) as its model. In order to achieve such purpose, quality score of Word Error Rate (WER) was computed on the transliteration output. Besides, the issues formerly encountered by rule based approach such as vocals limitation and homograph, reduplication, letters error and combination of multiple words were observed in the implementation. Moreover, this paper utilized exploratory approach as its research strategy and mixed method as its research method. The data for the analysis were extracted from a MM titled Bidyat al-Mubtad biFalill�h al-Muhd. Quality score of WER was computed for the evaluation of SMT output. Afterwards, related issues were identified and assessed. The research found that quality score of PBSMT for old jawi to modern jawi transliteration was high in terms of WER, however the issues of rule based were generally addressed by PBSMT except homograph. The research is however limited to the approach of SMT that solely focused on PBSMT as its model. Moreover, the corpus size was limited to one manuscript while SMT relies on corpus size. Nevertheless the research contributes to the wider coverage on Malay language as one of the under resource languages in NLP, in form of old and modern jawi. Besides, to the best of the researcher’s knowledge, it is also the first to apply SMT (PBSMT) approach on old jawi transliteration. Most importantly, the study is to contribute on MM’s studies.

Item Type:	Conference or Workshop Item (Plenary Papers)
Additional Information:	4621/79736
Uncontrolled Keywords:	jawi, Malay manuscript, old jawi, Statistical Machine Translation, Phrase Based Statistical Machine Translation, Natural Language Processing
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Information and Communication Technology Kulliyyah of Information and Communication Technology Kulliyyah of Information and Communication Technology > Department of Information System Kulliyyah of Information and Communication Technology > Department of Information System
Depositing User:	Dr. Muhamad Sadry Abu Seman
Date Deposited:	23 Mar 2020 10:06
Last Modified:	14 Jul 2020 16:42
URI:	http://irep.iium.edu.my/id/eprint/79736

Actions (login required)

View Item