Title: A recurrent neural network-based method for training probabilistic Support Vector Machine

Authors: Hadi Sadoghi Yazdi, Sohrab Effati, Zahra Saberi

Addresses: Computer Department, Ferdowsi University of Mashhad, Mashhad, Iran. ' Department of Mathematics, Ferdowsi University of Mashhad, Mashhad, Iran. ' Department of Mathematics, Sabzevar Tarbiat Moallem, University of Sabzevar, Sabzevar, Iran

Abstract: In this paper, Support Vector Machine (SVM) is reformulated to a recurrent neural network model which can be described by the nonlinear dynamic system. In the proposed algorithm, an iterative training procedure is proposed independent of initial point. Also probabilistic constraints are recommended for reducing effect of noisy samples in training procedure and appearance of incorrect Support Vectors (SV). Probabilistic constraints admit using knowledge about distribution function of samples. A set of differential equations is used to modelling of the proposed probabilistic SVM. These equations are converged to optimal solution for SVM. The Euler method is used to solve differential equation. The primal and dual problem of SVM is solved by this model. Enough information is given for finding optimal hyper plane. Capability of the proposed method is shown by experimental results in the Optical Character Recognition (OCR) and synthetic data.

Keywords: recurrent neural networks; differential equations; probabilistic constraints; probabilistic SVC; support vector machines; OCA; optical character recognition; nonlinear dynamic systems; iterative training; synthetic data.

DOI: 10.1504/IJSISE.2009.029330

International Journal of Signal and Imaging Systems Engineering, 2009 Vol.2 No.1/2, pp.57 - 65

Received: 18 Jul 2008
Accepted: 19 Dec 2008
Published online: 19 Nov 2009 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article