Image-based view synthesis for enhanced perception in teleoperation

Jean-Sebastien Perrier; Gady Agam; Paul Cohen

doi:10.1117/12.389344

23 June 2000 Image-based view synthesis for enhanced perception in teleoperation

Jean-Sebastien Perrier, Gady Agam, Paul Cohen

Proceedings Volume 4023, Enhanced and Synthetic Vision 2000; (2000) https://doi.org/10.1117/12.389344
Event: AeroSense 2000, 2000, Orlando, FL, United States

Abstract

The teleoperation of equipment under impoverished sensing and communication delays, cannot be handled efficiently by conventional remote control techniques. Our approach to this problem is based on an augmented reality control mode in which a graphical model of the equipment is overlaid upon real views from the work-site. A basic capability required in order to produce such an augmented reality mode is the ability to synthesize visual information from new viewpoints based upon existing ones, so as to compensate for the sparsity of real data. Our approach to the problem of image-based view synthesis is based upon the implicit construction of a 3D approximation of the scene, composed of planar triangular patches. New views are then generated by texture-mapping the available real image data onto the reprojected triangles. In order to generate a physically valid joint-triangulation which minimizes the distortions in the rendering of the new view, an iterative approach is utilized. This approach begins with an initial triangulation and refines it iteratively through node-linking alterations and a split and merge process, based upon correlation values between corresponding triangular patches. The paper presents results for both synthetic and real scenes.

Citation Download Citation

Jean-Sebastien Perrier, Gady Agam, and Paul Cohen "Image-based view synthesis for enhanced perception in teleoperation", Proc. SPIE 4023, Enhanced and Synthetic Vision 2000, (23 June 2000); https://doi.org/10.1117/12.389344

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available