Title: User-centric evaluation of recommender systems: a literature review

Authors: Krishnadas Nanath; Menahil Ahmed

Addresses: Computer Engineering and Informatics Department, Middlesex University Dubai, Knowledge Park, Dubai, UAE ' Computer Engineering and Informatics Department, Middlesex University Dubai, Knowledge Park, Dubai, UAE

Abstract: Recommender systems have seen a rapid rise of application in various industries, with several services now being implemented online. Over the years, various authors have been researching on how to improve the recommender system's performance and outcome with various algorithms and evaluation criteria. This research considers users as the end consumer of the recommender system and develops a systematic literature review for its evaluation from a user-centric perspective. It first presents the evaluation categories from a system testing view and then presents a novel framework of recommender system evaluation from a user feedback perspective. The study then presents a useful timeline for researchers who intend to use mathematical evaluation metrics in recommender system research. The three-step approach to this literature review will assist future research in getting a focused user-centric view on the recommender system's evaluation.

Keywords: recommender systems; timeline evaluation; user feedback; evaluation metrics.

DOI: 10.1504/IJBIS.2023.134950

International Journal of Business Information Systems, 2023 Vol.44 No.2, pp.303 - 323

Received: 30 Jul 2020
Accepted: 02 Nov 2020
Published online: 22 Nov 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article