Text normalization algorithm for facebook chats in Hausa language

Jaafar, Zubairu Maitama and Haruna, Usman and Gambo, Abdullahi Ya'u and Thomas, Bimba Andrew and Idris, Norisma and Ya’u Gital, Abdulsalam and Abubakar, Adamu (2014) Text normalization algorithm for facebook chats in Hausa language. In: Information and Communication Technology for The Muslim World (ICT4M), 2014 The 5th International Conference on, 17-18 November 2014, Kuching, Sarawak, Malaysia.

	PDF - Published Version Restricted to Repository staff only Download (304kB) | Request a copy
	PDF (SCOPUS) - Supplemental Material Restricted to Repository staff only Download (83kB) | Request a copy

Abstract

The rapid increase in using non-standard words (NSWs) in communication through the social media is causing difficulties in understanding contents of the text messages. In addition, it affects the performance of several natural language processing (NLP) task such as machine translation, information retrievals, summarization and etc. In this study, we present an automatic text normalization system on Facebook chatting based on Hausa language. The proposed algorithm manually developed dictionary that employ normalization of each non-standard word with its equivalent standard word. This is accomplished through modification of the technique employed by [1] to fit Hausa NSWs' formation. It was found that our proposed algorithm was able to normalized Hausa NSWs with an accuracy of 100%. The results of this research can facilitate comprehensive communication via Facebook using Hausa language.

Item Type:	Conference or Workshop Item (Plenary Papers)
Additional Information:	7132/40213
Uncontrolled Keywords:	Hausa; Text Normalization; Non-standard word; Facebook Chat
Subjects:	Q Science > Q Science (General) > Q300 Cybernetics > Q350 Information theory
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Information and Communication Technology > Department of Information System Kulliyyah of Information and Communication Technology > Department of Information System
Depositing User:	Dr Adamu Abubakar
Date Deposited:	30 Jan 2015 15:15
Last Modified:	26 Sep 2017 16:26
URI:	http://irep.iium.edu.my/id/eprint/40213

Actions (login required)

View Item