Information retrieval, question answering systems, and ChatGPT: technology, capability, and intelligence

Tengku Sembok, Tengku Mohd and Wani, Sharyar (2023) Information retrieval, question answering systems, and ChatGPT: technology, capability, and intelligence. Socialis Series in Social Science, 5. pp. 96-110. ISSN 2583-1585

PDF (Journal) - Published Version Restricted to Registered users only Download (1MB) | Request a copy

Abstract

The question is will ChatGPT replace Google? To answer the question, we have a look at the engine that powers ChatGPT. Knowing the engine that drives it, we may be able to estimate its capability and power. Information retrieval and question answering systems have been around for decades using well known technology to serve their purposes, such as keywords approach, semantic technology, predicate logic, and natural language processing. Several WH questions have been tested to assess the quality and the correctness of the answers given by ChatGPT. With respect to What, Where, and How questions, we found that ChatGPT seems to understand the questions and answer them quite well. But some facts embedded in the answers are found to be inaccurate. These may be due to the “hallucination” problem caused by the Large Language Models (LLMs) adopted in the engine. We wonder here whether ChatGPT, which adopts the Generative Pre-trained Transformer based on LLMs, has reasoning mechanism as in the rule-based systems. In conclusion, ChatGPT represents a significant leap forward in the field of question answering systems. However, it is important to recognize that ChatGPT and Google are not direct competitors, but rather complementary tools that serve different purposes.

Item Type:	Article (Journal)
Uncontrolled Keywords:	Artificial Intelligence, Information Retrieval, Question Answering Systems
Subjects:	T Technology > T Technology (General) T Technology > T Technology (General) > T10.5 Communication of technical information
Kulliyyahs/Centres/Divisions/Institutes (Can select more than one option. Press CONTROL button):	Kulliyyah of Information and Communication Technology > Department of Computer Science Kulliyyah of Information and Communication Technology > Department of Computer Science Kulliyyah of Information and Communication Technology Kulliyyah of Information and Communication Technology
Depositing User:	Prof Tengku Mohd T Sembok
Date Deposited:	08 Nov 2023 14:36
Last Modified:	08 Nov 2023 14:37
URI:	http://irep.iium.edu.my/id/eprint/107993

Actions (login required)

View Item