Title: Effect of stop word removal on the performance of naïve Bayesian methods for text classification in the Kannada language

Authors: R. Jayashree; K. Srikanta Murthy; Basavaraj S. Anami

Addresses: Department of Computer Science and Engineering, PES Institute of Technology, 100 ft. Ring Road, BSK III stage, Bangalore-560085, India ' Department of Computer Science and Engineering, PES Institute of Technology, 100 ft. Ring Road, BSK III stage, Bangalore-560085, India ' KLE Institute of Engineering, Hubli, India

Abstract: Stop words are high frequency words in a document, which add unrealistic requirement on the classifier, both in terms of time and space complexity. There has been considerable amount of work done in information retrieval in English, but information retrieval in the Kannada language is a new concept. The identification and removal of stop words in the Kannada language could be an important piece of work, as elimination of stop words would definitely reduce the feature space, which in turn would help in reducing time and space complexity. It is to be noted that there is no standard stop word list in the Kannada language. This warrants us to take up this task of developing an algorithm for removing structurally similar stop words. The stop word removal though reduces feature space, may not contribute to the improvement in the performance of the classifiers as is evident from our results.

Keywords: classifier performance; stop words; indexing; information retrieval; stop word removal; naive Bayesian methods; text classification; Kannada language.

DOI: 10.1504/IJAISC.2014.062824

International Journal of Artificial Intelligence and Soft Computing, 2014 Vol.4 No.2/3, pp.264 - 282

Received: 01 Jun 2013
Accepted: 28 Sep 2013
Published online: 28 Jun 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article