Automated image captioning with deep neural networks

Abdullah, Ahmad Zarir and Bashar, Saad and Ismail, Amelia Ritahani (2020) Automated image captioning with deep neural networks. Science in Information Technology Letters, 1 (1). ISSN 2722-4139

PDF - Published Version Restricted to Registered users only Download (903kB) | Request a copy

Abstract

Generating natural language descriptions of the content of an image automatically is a complex task. Though it comes naturally to humans, it is not the same when making a machine do the same. But undoubtedly, achieving this feature would remarkably change how machines interact with us. Recent advancement in object recognition from images has led to the model of captioning images based on the relation between the objects in it. In this research project, we are demonstrating the latest technology and algorithms for automated caption generation of images using deep neural networks. This model of generating a caption follows an encoder-decoder strategy inspired by the language-translation model based on Recurrent Neural Networks (RNN). The language translation model uses RNN for both encoding and decoding, whereas this model uses a Convolutional Neural Networks (CNN) for encoding and an RNN for decoding. This combination of neural networks is more suited for generating a caption from an image. The model takes in an image as input and produces an ordered sequence of words, which is the caption.

Item Type:	Article (Journal)
Uncontrolled Keywords:	Recurrent Neural Networks, Convolutional Neural Networks Image, Captioning
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Information and Communication Technology > Department of Computer Science Kulliyyah of Information and Communication Technology > Department of Computer Science
Depositing User:	Amelia Ritahani Ismail
Date Deposited:	02 Jan 2024 09:54
Last Modified:	02 Jan 2024 11:16
URI:	http://irep.iium.edu.my/id/eprint/109718

Actions (login required)

View Item