Deep learning-based fine-grained car make/model classification for visual surveillance

Erhan Gundogdu; Enes Sinan Parıldı; Berkan Solmaz; Veysel Yücesoy; Aykut Koç

doi:10.1117/12.2278862

5 October 2017 Deep learning-based fine-grained car make/model classification for visual surveillance

Erhan Gundogdu, Enes Sinan Parıldı, Berkan Solmaz, Veysel Yücesoy, Aykut Koç

Proceedings Volume 10441, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies; 104410J (2017) https://doi.org/10.1117/12.2278862
Event: SPIE Security + Defence, 2017, Warsaw, Poland

Abstract

Fine-grained object recognition is a potential computer vision problem that has been recently addressed by utilizing deep Convolutional Neural Networks (CNNs). Nevertheless, the main disadvantage of classification methods relying on deep CNN models is the need for considerably large amount of data. In addition, there exists relatively less amount of annotated data for a real world application, such as the recognition of car models in a traffic surveillance system. To this end, we mainly concentrate on the classification of fine-grained car make and/or models for visual scenarios by the help of two different domains. First, a large-scale dataset including approximately 900K images is constructed from a website which includes fine-grained car models. According to their labels, a state-of-the-art CNN model is trained on the constructed dataset. The second domain that is dealt with is the set of images collected from a camera integrated to a traffic surveillance system. These images, which are over 260K, are gathered by a special license plate detection method on top of a motion detection algorithm. An appropriately selected size of the image is cropped from the region of interest provided by the detected license plate location. These sets of images and their provided labels for more than 30 classes are employed to fine-tune the CNN model which is already trained on the large scale dataset described above. To fine-tune the network, the last two fully-connected layers are randomly initialized and the remaining layers are fine-tuned in the second dataset. In this work, the transfer of a learned model on a large dataset to a smaller one has been successfully performed by utilizing both the limited annotated data of the traffic field and a large scale dataset with available annotations. Our experimental results both in the validation dataset and the real field show that the proposed methodology performs favorably against the training of the CNN model from scratch.

Conference Presentation

Citation Download Citation

Erhan Gundogdu, Enes Sinan Parıldı, Berkan Solmaz, Veysel Yücesoy, and Aykut Koç "Deep learning-based fine-grained car make/model classification for visual surveillance", Proc. SPIE 10441, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies, 104410J (5 October 2017); https://doi.org/10.1117/12.2278862

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available