Learning ranks with neural networks

Khaled A. Al-Ghoneim; Bhagavatula Vijaya Kumar

doi:10.1117/12.205150

6 April 1995 Learning ranks with neural networks

Khaled A. Al-Ghoneim, Bhagavatula Vijaya Kumar

Proceedings Volume 2492, Applications and Science of Artificial Neural Networks; (1995) https://doi.org/10.1117/12.205150
Event: SPIE's 1995 Symposium on OE/Aerospace Sensing and Dual Use Photonics, 1995, Orlando, FL, United States

Abstract

Complex pattern recognition problems are not usually solved by a single classifier. Multiple classifiers are used instead. Typically, the classifiers are arranged hierarchically, such that the low level classifier (LLC) produces not only a single decision of its best guess of the class of the input pattern but a list of choices ranked according to their likelihood. The high level classifier (HLC) then chooses from this set of classes using additional information that is not usually available to or well represented in a single LLC, such as knowledge of the context or the model. Training neural networks (NNs) as low level classifiers has been traditionally performed independent of what the HLC may do. The traditional performance measure for evaluating classifiers is the classification counting function which counts the number of correct classifications performed by that classifier. It is of course desired that the LLC produces the correct classification (by ranking the correct class as the top choice). Moreover, it is preferred that the LLC ranks the correct class as the second choice if it is not able to correctly classify it (as the first choice). A new cost function (which accounts for the correctness of class rankings) is presented. When this cost function is optimized, it will achieve this desired ranking performance. The parameters of this new cost function will be linked to statistical parameters of our proposed hierarchical model. Unfortunately, this cost function cannot be used to train neural networks because it is not differentiable. Thus we investigate differentiable approximations that are well suited to training NNs using the backpropagation algorithm. Initial simulation results show that superiority of this new error measure over the traditional mean square error measure both in terms of classification and ranking performance.

Citation Download Citation

Khaled A. Al-Ghoneim and Bhagavatula Vijaya Kumar "Learning ranks with neural networks", Proc. SPIE 2492, Applications and Science of Artificial Neural Networks, (6 April 1995); https://doi.org/10.1117/12.205150

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available