An assessment of qualitative performance of machine learning architectures: modular feedback networks

IEEE Trans Neural Netw. 2008 Jan;19(1):183-9. doi: 10.1109/TNN.2007.902728.

Abstract

A framework for the assessment of qualitative performance of machine learning architectures is proposed. For generality, the analysis is provided for the modular nonlinear pipelined recurrent neural network (PRNN) architecture. This is supported by a sensitivity analysis, which is achieved based upon the prediction performance with respect to changes in the nature of the processed signal and by utilizing the recently introduced delay vector variance (DVV) method for phase space signal characterization. Comprehensive simulations combining the quantitative and qualitative analysis on both linear and nonlinear signals suggest that better quantitative prediction performance may need to be traded in order to preserve the nature of the processed signal, especially where the signal nature is of primary importance (biomedical applications).

MeSH terms

  • Algorithms
  • Artificial Intelligence*
  • Feedback*
  • Humans
  • Linear Models
  • Neural Networks, Computer*
  • Nonlinear Dynamics
  • Pattern Recognition, Automated
  • Signal Processing, Computer-Assisted