Title: In search of disruptive ideas: outlier detection techniques in crowdsourcing innovation platforms

Authors: Adam Westerski; Rajaraman Kanagasabai

Addresses: Institute for Infocomm Research, A*STAR, Singapore ' Institute for Infocomm Research, A*STAR, Singapore

Abstract: The key challenge for data science in open innovation web systems is to find best ideas among thousands of community submissions. To date, this has been done with metrics reflecting enterprise needs or community preferences. This article proposes to look in a different direction: inspired by theoretical studies on disruptive innovation, we frame the problem of valuable ideas as those rarely taken up by masses or organisations yet having potential to change industries. Our aim is to find technological means for automatic detection of such innovations to aid decision making. Following past findings from business sciences on nature of disruptive innovations, the article presents a comparative study of multiple outlier detection algorithms applied to two real-world datasets containing textual descriptions of ideas for different industries. Obtained results demonstrate capability of outlier detection and show k-NN algorithm with TF-IDF and cosine distance to be the best candidate for the task.

Keywords: idea management; disruptive innovation; outlier detection; data analytics; innovation management; open innovation systems; crowdsourcing.

DOI: 10.1504/IJWBC.2019.103185

International Journal of Web Based Communities, 2019 Vol.15 No.4, pp.344 - 367

Received: 19 Mar 2019
Accepted: 11 May 2019
Published online: 21 Oct 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article