Online multimodal compression using pruning and knowledge distillation for iris recognition

Abdul Latif, Samihah and Sidek, Khairul Azami and Abu Bakar, Eddyzulham and Hassan Abdalla Hashim, Aisha (2024) Online multimodal compression using pruning and knowledge distillation for iris recognition. Journal of Advanced Research in Applied Sciences and Engineering Technology, 37 (2). pp. 68-81. ISSN 2462-1943

Preview	PDF (SCOPUS) - Supplemental Material Download (165kB) | Preview
	PDF (Article) - Published Version Restricted to Registered users only Download (2MB) | Request a copy

Abstract

Deep learning models have advanced to the forefront of image recognition tasks, resulting in high-performing but enormous neural networks with millions to billions of parameters. Yet, deploying these models in production systems imposes considerable memory limits. Hence, the research community is increasingly aware of the need for compression strategies that can reduce the number of model parameters and their resource requirement. Current compression techniques for deep learning models have limitations in efficiency and effectiveness, indicating that more research is required to develop more efficient and practical techniques capable of balancing the trade-offs between compression rate, computational cost, and accuracy. This study proposed a multimodal method by combining multimodal Pruning and Knowledge Distillation techniques for compressing the iris recognition model, which is the size constraint for many image recognition models. To maintain accuracy while shrinking the model’s size, the models are trained, compressed, and further retrained in the downstream job. The analysis includes both fully connected and convolutional layers. Experimentally, the findings show that the proposed technique can achieve 91% accuracy, the same as the existing or original model. Besides that, the model compression can reduce the size of the model almost six times, from 529MB to 90MB, which is a significantly reduced rate. The primary outcome of this study is developing a CNN lightweight model for iris recognition technology that can be used on mobile devices and is resource constrained.

Item Type:	Article (Journal)
Additional Information:	4698/111162
Uncontrolled Keywords:	Model compression; pruning; knowledge distillation; iris recognition
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800 Electronics. Computer engineering. Computer hardware. Photoelectronic devices > TK7885 Computer engineering
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Engineering Kulliyyah of Engineering > Department of Electrical and Computer Engineering
Depositing User:	Assoc Prof Dr Khairul Azami Sidek
Date Deposited:	07 Mar 2024 10:47
Last Modified:	28 Aug 2024 12:59
URI:	http://irep.iium.edu.my/id/eprint/111162

Actions (login required)

View Item