Estimation of adaptive neuro-fuzzy inference system parameters with the expectation maximization algorithm and extended Kalman smoother

Cetisli B., EDİZKAN R.

NEURAL COMPUTING & APPLICATIONS, vol.20, no.3, pp.403-415, 2011 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 20 Issue: 3
  • Publication Date: 2011
  • Doi Number: 10.1007/s00521-010-0406-4
  • Journal Name: NEURAL COMPUTING & APPLICATIONS
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Page Numbers: pp.403-415
  • Eskisehir Osmangazi University Affiliated: Yes

Abstract

In this paper, we propose a new supervised learning method for adaptive neuro-fuzzy inference system (ANFIS) training, which uses the expectation maximization (EM) algorithm and extended Kalman smoother (EKS) together; we refer to it here as the EM-EKS training method. While the EKS tunes the ANFIS parameters, the EM algorithm estimates the parameters of the Kalman filter and avoids non-optimal performance. Besides, we also propose a new algorithm to select the initial values of the EKS parameters. We compare the EM-EKS method of ANFIS training with traditional ANFIS training. Although the new training method requires more computing time, it yields improved RMSE values in function approximation and prediction problems. Examples of benchmark function approximation and prediction illustrate the effectiveness of the EM-EKS ANFIS training method.