Subspace-based additive fuzzy systems for classification and dimension reduction

Thomas W. Jauch

doi:10.1117/12.284219

13 October 1997 Subspace-based additive fuzzy systems for classification and dimension reduction

Thomas W. Jauch

Proceedings Volume 3165, Applications of Soft Computing; (1997) https://doi.org/10.1117/12.284219
Event: Optical Science, Engineering and Instrumentation '97, 1997, San Diego, CA, United States

Abstract

In classification tasks the appearance of high dimensional feature vectors and small datasets is a common problem. It is well known that these two characteristics usually result in an oversized model with poor generalization power. In this contribution a new way to cope with such tasks is presented which is based on the assumption that in high dimensional problems almost all data points are located in a low dimensional subspace. A way is proposed to design a fuzzy system on a unified framework, and to use it to develop a new model for classification tasks. It is shown that the new model can be understood as an additive fuzzy system with parameter based basis functions. Different parts of the models are only defined in a subspace of the whole feature space. The subspaces are not defined a priori but are subject to an optimization procedure as all other parameters of the model. The new model has the capability to cope with high feature dimensions. The model has similarities to projection pursuit and to the mixture of experts architecture. The model is trained in a supervised manner via conjugate gradients and logistic regression, or backfitting and conjugate gradients to handle classification tasks. An efficient initialization procedure is also presented. In addition a technique based on oblique projections is presented which enlarges the capabilities of the model to use data with missing features. It is possible to use data with missing features in the training and in the classification phase. Based on the design of the model, it is possible to prune certain basis functions with an OLS (orthogonal least squares) based technique in order to reduce the model size. Results are presented on an artificial and an application example.

Citation Download Citation

Thomas W. Jauch "Subspace-based additive fuzzy systems for classification and dimension reduction", Proc. SPIE 3165, Applications of Soft Computing, (13 October 1997); https://doi.org/10.1117/12.284219

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available