Optical challenging feature inline measurement system based on photometric stereo and HON feature extractor

Huiyu Liu; Yunhui Yan; Kechen Song; Howard Chen

doi:10.1117/12.2309891

18 June 2018 Optical challenging feature inline measurement system based on photometric stereo and HON feature extractor

Huiyu Liu, Yunhui Yan, Kechen Song, Howard Chen

Author Affiliations +

Proceedings Volume 10678, Optical Micro- and Nanometrology VII; 1067812 (2018) https://doi.org/10.1117/12.2309891
Event: SPIE Photonics Europe, 2018, Strasbourg, France

Abstract

Inline, also known as on-line, measurement is one of the most important measurement techniques in automotive manufacturing industry, especially for body shop. Nowadays, optical measurement systems, which is most commonly used for inline measurement, are developing rapidly. However, some of dimensional features in body shop such as spot welding points, stud welding, high reflective surfaces and black painted materials, are still challenging for traditional optical inline systems to measure. Aiming at optical challenging dimensional features, a measuring system with cameras and fixed illuminations is developed to achieve robust and accurate measurement. Photometric stereo technique is used to obtain the surface normal map of the feature, so the algorithm can adapt to various reflections of the material. A Histogram of Oriented Normals (HON) extractor is proposed to extract the feature vector, which is small enough to fit a neural network, from normal map. After building a database with 1000 normal map and corresponding feature position, an artificial neural network is trained for localization the feature from 2D image. Combining 2D information from two different cameras, the 3D coordinate will be available with triangulation. Comparing with traditional HOG bench mark extractor, proposed system showed significant advantage on optical challenging materials in the experiment with welded stud sample. Comparing with off-line measurement systems, proposed system takes much less time, which gives the potential for optical challenging features inline measurement.

Citation Download Citation

Huiyu Liu, Yunhui Yan, Kechen Song, and Howard Chen "Optical challenging feature inline measurement system based on photometric stereo and HON feature extractor", Proc. SPIE 10678, Optical Micro- and Nanometrology VII, 1067812 (18 June 2018); https://doi.org/10.1117/12.2309891

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available