The effect of dataset imbalance on the performance of SCADA intrusion detection systems

Balla, Asaad and Habaebi, Mohamed Hadi and Elsheikh, Elfatih A. A. and Islam, Md. Rafiqul and Suliman, F.M. (2023) The effect of dataset imbalance on the performance of SCADA intrusion detection systems. Sensors, 23 (2). pp. 1-13. E-ISSN 1424-8220

	PDF (Article) - Published Version Restricted to Registered users only Download (902kB) | Request a copy
Preview	PDF (WOS) - Supplemental Material Download (588kB) | Preview
Preview	PDF - Supplemental Material Download (132kB) | Preview

Abstract

Integrating IoT devices in SCADA systems has provided efficient and improved data collection and transmission technologies. This enhancement comes with significant security challenges, exposing traditionally isolated systems to the public internet. Effective and highly reliable security devices, such as intrusion detection system (IDSs) and intrusion prevention systems (IPS), are critical. Countless studies used deep learning algorithms to design an efficient IDS; however, the fundamental issue of imbalanced datasets was not fully addressed. In our research, we examined the impact of data imbalance on developing an effective SCADA-based IDS. To investigate the impact of various data balancing techniques, we chose two unbalanced datasets, the Morris power dataset, and CICIDS2017 dataset, including random sampling, one-sided selection (OSS), near-miss, SMOTE, and ADASYN. For binary classification, convolutional neural networks were coupled with long short-term memory (CNN-LSTM). The system’s effectiveness was determined by the confusion matrix, which includes evaluation metrics, such as accuracy, precision, detection rate, and F1-score. Four experiments on the two datasets demonstrate the impact of the data imbalance. This research aims to help security researchers in understanding imbalanced datasets and their impact on DL SCADA-IDS.

Item Type:	Article (Journal)
Uncontrolled Keywords:	IDS; ICS; SCADA; imbalanced datasets; cyber security
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK5101 Telecommunication. Including telegraphy, radio, radar, television
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering Kulliyyah of Engineering > Department of Electrical and Computer Engineering
Depositing User:	Dr. Mohamed Hadi Habaebi
Date Deposited:	10 Jan 2023 09:26
Last Modified:	20 Jun 2023 16:25
URI:	http://irep.iium.edu.my/id/eprint/103118

Actions (login required)

View Item