JISE


  [1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] [16] [17] [18] [19] [20] [21] [22] [23]


Journal of Information Science and Engineering, Vol. 42 No. 5, pp. 1359-1371


LLM and Retrieval Augmented Generation-based Student Support System for University Students


HARSHA GAIKWAD+, YOGESH PATIL, SANIL GANDHI,
ARVIND KIWELEKAR AND SAHIL SHRIWARDHANKAR
Department of Computer Engineering
Dr. Babasaheb Ambedkar Technological University
Lonere, Raigad (MH), 402103 India
E-mail: {harsha.gaikwad
+; ynpatil; ssgandhi; awk}@dbatu.ac.in;
sahiilshriwardhankar@gmail.com


Adopting Large Language Models (LLM) has markedly improved the user assistance system. LLM-based chatbots such as ChatGPT, Gemini, andMetaAI are extensively utilised for customer support. This nascent technology is gaining prominence across many sectors, including education. Chatbot technology can deliver prompt and customised services to all individuals within the system. LLM-based chatbots are susceptible to hallucination due to occasional inaccuracies in the given content. Retrieval Augmented Generation (RAG) is an exceptionally effective solution to this issue, especially in knowledge-intensive fields such as education, where responses must be correct and precise. This article presents a chatbot designed using LLM and RAG to assist students at the university. Quantitative parameters like BERTScore and ROUGE score, as well as qualitative factors, including hallucination and accuracy, evaluate the chatbot’s performance.


Keywords: large language model, retrieval augmented generation, chatbot, education, Facebook AI similarity search

  Retrieve PDF document (JISE_202605_02.pdf)