Article: A novel multi-class ensemble model based on feature selection using Hadoop framework for classifying imbalanced biomedical data Journal: International Journal of Business Intelligence and Data Mining (IJBIDM) 2019 Vol.14 No.1/2 pp.25 - 39 Abstract: Due to the exponential growth of biomedical repositories such as PubMed and Medline, an accurate predictive model is essential for knowledge discovery in Hadoop environment. Traditional decision tree models such as multivariate Bernoulli model, random forest and multinominal naïve Bayesian tree use attribute selection measures to decide best split at each node of the decision tree. Also, the efficiency of document analysis in Hadoop framework is limited mainly due to the class imbalance problem and large candidate sets. In this paper, we proposed a two phase map-reduce framework with text preprocessor and classification model. In the first phase, mapper based preprocessing method was designed to eliminate irrelevant features, missing values and outliers from the biomedical data. In the second phase, a map-reduce based multi-class ensemble decision tree model was designed and implemented on the preprocessed mapper data to improve the true positive rate and computational time. The experimental results on the complex biomedical datasets show that the performance of our proposed Hadoop based multi-class ensemble model significantly outperforms state-of-the-art baselines. Inderscience Publishers - linking academia, business and industry through research

Title: A novel multi-class ensemble model based on feature selection using Hadoop framework for classifying imbalanced biomedical data

Authors: Thulasi Bikku; N. Sambasiva Rao; Ananda Rao Akepogu

Addresses: Department of CSE, VNITSW, Vignan's Nirula Institute of Technology and Science for Women, Palakalur, Guntur-522005, Andhra Pradesh, India ' SRITW, Sumathi Reddy Institute of Technology for Women, Ananthasagar, Hasanparthy, Warangal, Telangana, India ' JNTUCEA, Jawaharlal Nehru Technological University, Anantapur, Andhra Pradesh, India

Abstract: Due to the exponential growth of biomedical repositories such as PubMed and Medline, an accurate predictive model is essential for knowledge discovery in Hadoop environment. Traditional decision tree models such as multivariate Bernoulli model, random forest and multinominal naïve Bayesian tree use attribute selection measures to decide best split at each node of the decision tree. Also, the efficiency of document analysis in Hadoop framework is limited mainly due to the class imbalance problem and large candidate sets. In this paper, we proposed a two phase map-reduce framework with text preprocessor and classification model. In the first phase, mapper based preprocessing method was designed to eliminate irrelevant features, missing values and outliers from the biomedical data. In the second phase, a map-reduce based multi-class ensemble decision tree model was designed and implemented on the preprocessed mapper data to improve the true positive rate and computational time. The experimental results on the complex biomedical datasets show that the performance of our proposed Hadoop based multi-class ensemble model significantly outperforms state-of-the-art baselines.

Keywords: ensemble model; Hadoop; imbalanced data; medical databases; textual decision patterns.

DOI: 10.1504/IJBIDM.2019.096801

International Journal of Business Intelligence and Data Mining, 2019 Vol.14 No.1/2, pp.25 - 39

Received: 12 Dec 2016
Accepted: 10 Mar 2017
Published online: 11 Dec 2018 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article

Title: A novel multi-class ensemble model based on feature selection using Hadoop framework for classifying imbalanced biomedical data

Keep up-to-date