Scene text detection and recognition system for visually impaired people in real world

Lei Fei; Kaiwei Wang; Shufei Lin; Kailun Yang; Ruiqi Cheng; Hao Chen

doi:10.1117/12.2325523

9 October 2018 Scene text detection and recognition system for visually impaired people in real world

Lei Fei, Kaiwei Wang, Shufei Lin, Kailun Yang, Ruiqi Cheng, Hao Chen

Proceedings Volume 10794, Target and Background Signatures IV; 107940S (2018) https://doi.org/10.1117/12.2325523
Event: SPIE Security + Defence, 2018, Berlin, Germany

Abstract

Visually Impaired (VI) people around the world have difficulties in socializing and traveling due to the limitation of traditional assistive tools. In recent years, practical assistance systems for scene text detection and recognition allow VI people to obtain text information from surrounding scenes. However, real-world scene text features complex background, low resolution, variable fonts as well as irregular arrangement which make it difficult to achieve robust scene text detection and recognition. In this paper, a scene text recognition system to help VI people is proposed. Firstly, we propose a high-performance neural network to detect and track objects, which is applied to specific scenes to obtain Regions of Interest (ROI). In order to achieve real-time detection, a light-weight deep neural network has been built using depth-wise separable convolutions that enables the system to be integrated into mobile devices with limited computational resources. Secondly, we train the neural network using the textural features to improve the precision of text detection. Our algorithm suppresses the effects of spatial transformation (including translation, scaling, rotation as well as other geometric transformations) based on the spatial transformer networks. Open-source optical character recognition (OCR) is used to train scene texts individually to improve the accuracy of text recognition. The interactive system eventually transfers the number and distance information of inbound buses to visually impaired people. Finally, a comprehensive set of experiments on several benchmark datasets demonstrates that our algorithm has achieved an extraordinary trade-off between precision and resource usage.

Conference Presentation

Citation Download Citation

Lei Fei, Kaiwei Wang, Shufei Lin, Kailun Yang, Ruiqi Cheng, and Hao Chen "Scene text detection and recognition system for visually impaired people in real world", Proc. SPIE 10794, Target and Background Signatures IV, 107940S (9 October 2018); https://doi.org/10.1117/12.2325523

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available