Image-based querying of urban knowledge databases

Peter Cho; Soonmin Bae; Fredo Durand

doi:10.1117/12.818164

11 May 2009 Image-based querying of urban knowledge databases

Peter Cho, Soonmin Bae, Fredo Durand

Proceedings Volume 7336, Signal Processing, Sensor Fusion, and Target Recognition XVIII; 733614 (2009) https://doi.org/10.1117/12.818164
Event: SPIE Defense, Security, and Sensing, 2009, Orlando, Florida, United States

Abstract

We extend recent automated computer vision algorithms to reconstruct the global three-dimensional structures for photos and videos shot at fixed points in outdoor city environments. Mosaics of digital stills and embedded videos are georegistered by matching a few of their 2D features with 3D counterparts in aerial ladar imagery. Once image planes are aligned with world maps, abstract urban knowledge can propagate from the latter into the former. We project geotagged annotations from a 3D map into a 2D video stream and demonstrate their tracking buildings and streets in a clip with significant panning motion. We also present an interactive tool which enables users to select city features of interest in video frames and retrieve their geocoordinates and ranges. Implications of this work for future augmented reality systems based upon mobile smart phones are discussed.

Citation Download Citation

Peter Cho, Soonmin Bae, and Fredo Durand "Image-based querying of urban knowledge databases", Proc. SPIE 7336, Signal Processing, Sensor Fusion, and Target Recognition XVIII, 733614 (11 May 2009); https://doi.org/10.1117/12.818164

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available