Abstract
This paper describes a modification to the learning algorithm and architecture of the self-organizing fuzzy neural network (SOFNN) to improve learning ability. Previously the SOFNN’s computational efficiency was improved using a new method of checking the network structure after it has been modified. Instead of testing the entire structure every time it has been modified, a record is kept of each neuron’s firing strength for all data previously clustered by the network. This record is updated as training progresses and is used to reduce the computational load of checking network structure changes, to ensure performance degradation does not occur, resulting insignificantly reduced training times. To exploit the temporal information contained in the record of saved firing strengths, anew architecture of the SOFNN is proposed in this paper where current feedback connections are added to neurons in layer three of the structure. Recurrent connections allow the network to learn the temporal information from the data and, in contrast to pure feed forward architectures, which exhibit static input output behavior in advance, recurrent models are able to store information from the past (e.g., past measurements of the time series)and are therefore better suited to analyzing dynamic systems. Each recurrent feedback connection includes a weight which must be learned. In this work a learning approach is proposed where the recurrent feedback weight is updated online(not iteratively) and proportional to the aggregate firing activity of each fuzzy neuron. It is shown that this modification, which conforms to the requirements for autonomy and has no additional hyper-parameters, can significantly improve the performance of the SOFNN’s prediction capacity under certain constraints
Original language | English |
---|---|
Title of host publication | 2011 IEEE Workshop on Evolving and Adaptive Intelligent Systems (EAIS) |
Place of Publication | U. S. A. |
Publisher | IEEE Xplore |
Pages | 1-8 |
Number of pages | 8 |
ISBN (Print) | 9781424499786 |
DOIs | |
Publication status | Published - 15 Apr 2011 |
Event | 2011 IEEE Workshop on Evolving and Adaptive Intelligent Systems (EAIS) - Paris, France Duration: 11 Apr 2011 → 15 Apr 2011 |
Workshop
Workshop | 2011 IEEE Workshop on Evolving and Adaptive Intelligent Systems (EAIS) |
---|---|
Country/Territory | France |
City | Paris |
Period | 11/04/11 → 15/04/11 |