Semantic attributes for people’s appearance description: an appearance modality for video surveillance applications

Mayssa Frikha; Emna Fendri; Mohamed Hammami

doi:10.1117/1.JEI.26.5.051405

18 July 2017 Semantic attributes for people’s appearance description: an appearance modality for video surveillance applications

Mayssa Frikha, Emna Fendri, Mohamed Hammami

Author Affiliations +

Journal of Electronic Imaging, Vol. 26, Issue 5, 051405 (July 2017). https://doi.org/10.1117/1.JEI.26.5.051405

Abstract

Using semantic attributes such as gender, clothes, and accessories to describe people’s appearance is an appealing modeling method for video surveillance applications. We proposed a midlevel appearance signature based on extracting a list of nameable semantic attributes describing the body in uncontrolled acquisition conditions. Conventional approaches extract the same set of low-level features to learn the semantic classifiers uniformly. Their critical limitation is the inability to capture the dominant visual characteristics for each trait separately. The proposed approach consists of extracting low-level features in an attribute-adaptive way by automatically selecting the most relevant features for each attribute separately. Furthermore, relying on a small training-dataset would easily lead to poor performance due to the large intraclass and interclass variations. We annotated large scale people images collected from different person reidentification benchmarks covering a large attribute sample and reflecting the challenges of uncontrolled acquisition conditions. These annotations were gathered into an appearance semantic attribute dataset that contains 3590 images annotated with 14 attributes. Various experiments prove that carefully designed features for learning the visual characteristics for an attribute provide an improvement of the correct classification accuracy and a reduction of both spatial and temporal complexities against state-of-the-art approaches.

Citation Download Citation

Mayssa Frikha, Emna Fendri, and Mohamed Hammami "Semantic attributes for people’s appearance description: an appearance modality for video surveillance applications," Journal of Electronic Imaging 26(5), 051405 (18 July 2017). https://doi.org/10.1117/1.JEI.26.5.051405

Received: 4 January 2017; Accepted: 22 June 2017; Published: 18 July 2017

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available