» Download Article
Exploiting the Functional Training Approach in B-Splines
Embedded Systems, Computational Intelligence and Telematics in Control, Volume # | Part# 1
Authors
Ruano, Antonio; Cabrita, Cristiano; Ferreira, Pedro M.; Koczy, Laszlo T.
Digital Object Identifier (DOI)
10.3182/20120403-3-DE-3010.00070
Page Numbers:
127-132
Index Terms
Design methodologies
Abstract
When used for function approximation purposes, neural networks belong to a class of models whose parameters can be separated into linear and nonlinear, according to their influence in the model output. This concept of parameter separability can also be applied when the training problem is formulated as the minimization of the integral of the (functional) squared error, over the input domain. Using this approach, the computation of the gradient involves terms that are dependent only on the model and the input domain, and terms which are the projection of the target function on the basis functions and on their derivatives with respect to the nonlinear parameters, over the input domain. These later terms can be numerically computed with the data. The use of the functional approach is introduced here for B-splines. An example shows that, besides great computational complexity savings, this approach obtains better results than the standard, discrete technique, as the performance surface employed is more similar to the one obtained with the function underlying the data. In some cases, as shown in the example, a complete analytical solution can be found.
References
Brown, M., and Harris, C., (1994), Neurofuzzy Adaptive Modelling and control, Prentice-Hall. Cabrita, C. L., Ruano, A. E., and Ferreira, P. M. (2011), Exploiting the Functional Training Approach in Radial Basis Function Networks, IEEE Symposium on Intelligent Signal Processing (WISP 2011), Floriana, Malta. Gill, P. E., Murray, W. and Wright, M. H. (1981), Practical Optimization. Academic Press, Inc. Golub, G. H. and Pereyra, V. (1973), Differentiation of Pseudo-Inverses and Nonlinear Least-Squares Problems Whose Variables Separate, Siam Journal on Numerical Analysis, vol 10, pp. 413-432. Golub, G. and Pereyra, V. (2003), Separable Nonlinear Least Squares: The Variable Projection Method and Its Applications, Inverse Problems, (19), R1-R26. Ruano, A. E., Cabrita, C., Oliveira, J. V. and Koczy, L. T., (2002), Supervised Training Algorithms for B-Spline Neural Networks and Neuro-Fuzzy Systems, International Journal of Systems Science, (33), 689-711. Ruano, A.E., Cabrita, C.L., Ferreira, P. M., (2011), Towards a More Analytical Training of Neural Networks and Neuro-Fuzzy Systems, IEEE Symposium on Intelligent Signal Processing, Malta, Floriana, Malta. Sjoberg, J. and Viberg, M. (1997), Separable Non-Linear Least-Squares Minimization - Possible Improvements for Neural Net Fitting, Neural Networks for Signal Processing VII, 345-354.