Meteorological time series forecasting with pruned multi-layer perceptron and two-stage Levenberg-Marquardt method
by Cyril Voyant; Wani Tamas; Marie-Laure Nivet; Gilles Notton; Christophe Paoli; Aurélia Balu; Marc Muselli
International Journal of Modelling, Identification and Control (IJMIC), Vol. 23, No. 3, 2015

Abstract: A multi-layer perceptron (MLP) defines a family of artificial neural networks often used in TS modelling and forecasting. Because of its 'black box' aspect, many researchers refuse to use it. Moreover, the optimisation (often based on the exhaustive approach where 'all' configurations are tested) and learning phases of this artificial intelligence tool (often based on the Levenberg-Marquardt algorithm - LMA) are weaknesses of this approach (exhaustively and local minima). These two tasks must be repeated depending on the knowledge of each new problem studied, making the process, long, laborious and not systematically robust. In this paper, a pruning process is proposed. This method allows, during the training phase, to carry out an inputs selecting method activating (or not) inter-nodes connections in order to verify if forecasting is improved. We propose to use iteratively the popular damped least-squares method to activate inputs and neurons. A first pass is applied to 10% of the learning sample to determine weights significantly different from 0 and delete other. Then, a classical batch process based on LMA is used with the new MLP. The validation is done using 25 measured meteorological TS and cross-comparing the prediction results of the classical LMA and the two-stage LMA.

Online publication date: Tue, 16-Jun-2015

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Modelling, Identification and Control (IJMIC):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com