Title: Note on the curse of dimensionality regarding financial anomaly detection

Authors: Sarah Oliveira Pinto; Vinicius Amorim Sobreiro

Addresses: Department of Management, University of Brasília, Campus Darcy Ribeiro, Brasília, Federal District, 70910-900, Brazil ' Department of Management, University of Brasília, Campus Darcy Ribeiro, Brasília, Federal District, 70910-900, Brazil

Abstract: The so-called curse of dimensionality represents limitations to the processes of manipulation, interpretation and analysis of high dimensional data, which makes identifying behaviour patterns in cursed dimensional feature spaces complex. Several recently published articles discussed the need to use dimensionality reduction methods when considering the issue of detecting anomalies in financial systems. However, most articles developed models that did not consider real-time data or the continuous generation of information. They also did not directly address how to overcome situations arising from a great volume of data. This short communication reports on articles that used voluminous but static data, and articles that used real-time data to identify anomalies in financial systems but did not significantly address the issues related to dimensionality. Furthermore, this note signals the need for further investigation of how to break the curse of dimensionality through developing financial anomaly detection models to promote better decision support systems.

Keywords: curse of dimensionality; high dimensional data; anomaly detection; financial systems.

DOI: 10.1504/IJBISE.2024.139149

International Journal of Business Intelligence and Systems Engineering, 2024 Vol.2 No.1, pp.77 - 87

Accepted: 05 Feb 2024
Published online: 15 Jun 2024 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article