Input significance analysis: Feature selection through synaptic weights manipulation for EFuNNs classifier

Hassan, Raini and Taha Alshaikhli, Imad Fakhri and Ahmad, Salmiah (2017) Input significance analysis: Feature selection through synaptic weights manipulation for EFuNNs classifier. Journal of Fundamental and Applied Sciences, 9 (4S). pp. 681-709. E-ISSN 1112-9867

PDF - Published Version Restricted to Registered users only Download (787kB) | Request a copy

Abstract

Today’s digital lifestyles are changing rapidly and already moving towards the Big Data phenomenon. The data stored or collected from these digital activities can be so large or complex, and caused the traditional data processing algorithms or software to be inadequate when used to process them. Specifically for the classification process, Big Data can cause the classifiers to process longer than necessary, and the redundant or irrelevant data may misguide the learning classification algorithms to learn the random error or noise related to them. Other than that, the online environment that display, collect, manipulate and store the data can cause the dataset to grow larger, in sync with the online processes. This can pose even greater problems for the classifiers because it means the already massive dataset will be growing in very short time. Therefore, there must be a way to overcome this problem. This work proposed to apply Input Significance Analysis (ISA) to identify redundant and irrelevant data, and hence can speed up the processing time. Additionally, the ISA processes may also resemble variable or feature selection (FS) that refers to the feature irrelevance, in which, when removed, the remaining features will improve, be the measure of, among others, accuracy and consistency. This work is a continuation of the previous work that focused on a process prior to FS, which is Feature Ranking (FR). FR is referring to a process of re-arranging the order of the input data/features according to the importance value obtained from the ISA methods. As in the previous work, this work is particularly interested in ISA methods that can manipulate synaptic weights; namely Connection Weights (CW) and Garson’s Algorithm (GA), and the classifier selected is Evolving Fuzzy Neural Networks (EFuNNs). The goals for this work are, first, to test FS method on a dataset selected from the UCI Machine Learning Repository and executed in an online environment, record the results, and later compared with the results that used original and ranked data from the previous work. This is to identify whether FS can contribute to improved results, and which of the ISA methods mentioned above that work well with FS, i.e. give the best results. Secondly, to attest the FS results by using a differently selected dataset taken from the same source, and in the same environment. There are two groups of experiments conducted to accomplish these goals. The results are promising; when FS is applied, some efficiency and accuracy are noticeable, compared to the original and ranked data.

Item Type:	Article (Journal)
Additional Information:	4964/61240
Uncontrolled Keywords:	feature selection; feature ranking; input significance analysis; evolving connectionist systems; evolving fuzzy neural network; connection weights; Garson’s algorithm
Subjects:	Q Science > Q Science (General) Q Science > QA Mathematics
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Information and Communication Technology > Department of Computer Science Kulliyyah of Information and Communication Technology > Department of Computer Science
Depositing User:	Dr. Raini Hassan
Date Deposited:	11 Jan 2018 15:38
Last Modified:	20 Mar 2018 11:39
URI:	http://irep.iium.edu.my/id/eprint/61240

Actions (login required)

View Item