Visual servoing of a 5-DOF mobile manipulator using a catadioptric vision system

Y. Zhang; M. Mehrandezh

doi:10.1117/12.754581

8 October 2007 Visual servoing of a 5-DOF mobile manipulator using a catadioptric vision system

Y. Zhang, M. Mehrandezh

Proceedings Volume 6719, Optomechatronic Systems Control III; 671906 (2007) https://doi.org/10.1117/12.754581
Event: International Symposium on Optomechatronic Technologies, 2007, Lausanne, Switzerland

Abstract

In this paper, a novel visual servoing technique for a 5-dof mobile manipulator with an eye-to-hand camera configuration is introduced. The proposed technique can be categorized as an image based (or 2D) visual servoing using a fixed camera in conjunction with a conic mirror (aka, a Catadioptric camera system) providing panoramic vision. Two fictitious landmarks mounted on robot's end-effector along with their mirror reflections, when viewed by the camera, provide enough information for 3D reasoning based on the four points viewed on the image plane. Instead of directly using the image features associated with these four points, five new image features are chosen to make the image Jacobian rank efficient. A dual estimation/control strategy based on Extended Kalman Filter (EKF) is utilized to (1) estimate camera's intrinsic and extrinsic parameters, and (2) track the coordinates of the landmarks and their reflections on the image plane. The relationship between the translational and rotational velocity of a frame attached to the robot's end-effector and the rate of change of the proposed image features are fully formulated. The robustness of the proposed technique in translational and rotational servoing of a 5-dof holonomic mobile manipulator is illustrated through computer simulations.

Citation Download Citation

Y. Zhang and M. Mehrandezh "Visual servoing of a 5-DOF mobile manipulator using a catadioptric vision system", Proc. SPIE 6719, Optomechatronic Systems Control III, 671906 (8 October 2007); https://doi.org/10.1117/12.754581

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available