Title: Open set recognition through Monte Carlo dropout-based uncertainty

Authors: Xiaojie Yin; Qinghua Hu; Gerald Schaefer

Addresses: College of Intelligence and Computing, Tianjin University, Jinnan, Tianjin, China ' College of Intelligence and Computing, Tianjin University, Jinnan, Tianjin, China ' Department of Computer Science, Loughborough University, Loughborough, UK

Abstract: Open set recognition has received much attention in recent years. In this paper, we present a novel open set recognition method that is able to obtain improved recognition by applying Monte Carlo dropout to capture uncertainty in order to yield high quality predicted probabilities. Experimental results on six benchmark datasets show that our method gives better open set recognition performance than other state-of-the-art methods, with at least 6.4%, 3.9%, 2.9% and 1.0% performance increase in AUROC on the challenging object datasets CIFAR-10, CIFAR+10, CIFAR+50 and TinyImageNet respectively. We also perform an analysis on the benefits of combining predictive uncertainty with an EVT-based open set recognition model which indicates that Monte Carlo dropout-based uncertainty allows to obtain high quality predicted probabilities and to learn more accurate open set recognition scores. This, in turn, helps to reduce the overlap between known and unknown classes, thus making them more separable.

Keywords: open set recognition; Monte Carlo dropout; predictive uncertainty.

DOI: 10.1504/IJBIC.2021.119982

International Journal of Bio-Inspired Computation, 2021 Vol.18 No.4, pp.210 - 220

Received: 03 Feb 2021
Accepted: 22 Feb 2021
Published online: 04 Jan 2022 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article