|
|
| Record Number | 872 |
| Reference Type | Book Section |
| Author(s) | Schaal, S.;Atkeson, C. G. |
| Year | 1996 |
| Title | From isolation to cooperation: An alternative of a system of experts |
| Journal/Conference/Book Title | Advances in Neural Information Processing Systems 8 |
| Label | Scha96b |
| Keywords | statistical learning, nonparametric regression, distance metric, supersmoothing, mixture model, incremental learning |
Abstract |
We introduce a constructive, incremental learning system for regression problems that models data by means of locally linear experts. In contrast to other approaches, the experts are trained independently and do not compete for data during learning. Only when a prediction for a query is required do the experts cooperate by blending their individual predictions. Each expert is trained by minimizing a penalized local cross validation error using second order methods. In this way, an expert is able to adjust the size and shape of the receptive field in which its predictions are valid, and also to adjust its bias on the importance of individual input dimensions. The size and shape adjustment corresponds to finding a local distance metric, while the bias adjustment accomplishes local dimensionality reduction. We derive asymptotic results for our method. In a variety of simulations we demonstrate the properties of the algorithm with respect to interference, learning speed, prediction accuracy, feature detection, and task oriented incremental learning.
|
| Notes | clmc |
| URL(s) | http://www-clmc.usc.edu/publications/S/schaal-NIPS1996.pdf
|
| Editor(s) | Touretzky, D. S.;Mozer, M. C.;Hasselmo, M. E. |
| Place Published | Cambridge, MA |
| Publisher | MIT Press |
| Pages | 605-611 |
| Short Title | From isolation to cooperation: An alternative of a system of experts |
| Papers are available as Adobe PDF ".pdf" files. Adobe Reader is available for free for all computer platforms.
|
|
|
|
|
Page last modified on August 10, 2006, at 06:47 PM
|
|
