Human confusion costs for object classification

Yang Wu; Yuanliu Liu; Zejian Yuan; Nanning Zheng

doi:10.1117/1.3533729

1 February 2011 Human confusion costs for object classification

Yang Wu, Yuanliu Liu, Zejian Yuan, Nanning Zheng

Author Affiliations +

Optical Engineering, Vol. 50, Issue 2, 027201 (February 2011). https://doi.org/10.1117/1.3533729

Abstract

Most of the traditional evaluation criteria of object classification are based on the error rate, assuming that the costs of different errors are equal. However, the subjective evaluation of the human vision system on such misclassification errors may be unequal. How do we design proper performance evaluation critera taking into account such inequalities is a kernel issue for mimicking the human vision on object classification. We propose the human confusion costs, which are derived from the statistical human confusions on the training and test data sets, for the model learning and the performance evaluation of the generic cost-sensitive object classification problem, respectively. Unlike the manually designed costs, the proposed ones can better represent the properties of human vision. Experimental results on a new data set with annotations from 20 subjects demonstrate the superiority of the proposed costs against other applicable costs.

©(2011) Society of Photo-Optical Instrumentation Engineers (SPIE)

Citation Download Citation

Yang Wu, Yuanliu Liu, Zejian Yuan, and Nanning Zheng "Human confusion costs for object classification," Optical Engineering 50(2), 027201 (1 February 2011). https://doi.org/10.1117/1.3533729

Published: 1 February 2011

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available