IntegriFy: an explainable AI-based framework for deepfake audio and video detection

Nazatul Rizal, Putri Syamimi Balqis and Kasim, Suria Aznisya and Idris, Aizal Yusrina and Khamis, Shakiroh and Ishak, Zurida and Ahmad Salleh, Khairulliza (2026) IntegriFy: an explainable AI-based framework for deepfake audio and video detection. In: 2026 7th International Conference on Artificial Intelligence and Data Science (AiDAS), 2-3 September 2026, Universiti Malaysia Sabah, Sabah.

PDF - Published Version Restricted to Repository staff only Download (3MB) | Request a copy

Abstract

The rapid spread of manipulated media, particularly deepfake audio and video, poses a significant threat to information integrity on digital platforms. To address this challenge, a web-based detection system called IntegriFy is developed using artificial intelligence techniques. The system integrates a Random Forest classifier trained on Mel-Frequency Cepstral Coefficient (MFCC) features for audio detection with a MobileNetV2 Convolutional Neural Network (CNN) for video detection. To enhance interpretability, Grad-CAM heatmaps are incorporated for visual explanation of video predictions, while textual explanations are provided for audio classification results. The backend infrastructure, hosted on Firebase and DigitalOcean, securely manages file uploads, user authentication, and historical tracking, while the frontend interface is designed for usability and accessibility. Experimental evaluation demonstrates 96% accuracy for audio detection and 78% accuracy for video detection, indicating reliable performance in identifying manipulated media. Future enhancements include improving video detection accuracy, implementing multi-factor authentication, enabling real-time detection, and providing shareable result links. Overall, IntegriFy offers an accessible and explainable solution to mitigate digital misinformation and support users including social media moderators, journalists, and the general public in assessing media authenticity.

Item Type:	Proceeding Paper (Other)
Uncontrolled Keywords:	deepfake detection, audio detection, video detection, explainable AI (XAI), MobileNetV2, convolutional neural networks (CNN), random forest classifier, Mel-frequency cepstral coefficients (MFCC), Grad-CAM
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Information and Communication Technology Kulliyyah of Information and Communication Technology Kulliyyah of Information and Communication Technology > Department of Computer Science Kulliyyah of Information and Communication Technology > Department of Computer Science
Depositing User:	Dr. Aizal Yusrina Idris
Date Deposited:	15 Oct 2026 16:41
Last Update:	15 Oct 2026 16:41
Queue Number:	2026-10-Q5618
URI:	http://irep.iium.edu.my/id/eprint/131955
Indexed In:	Google Scholar

Actions (login required)

View Item