Eye-to-hand robotic tracking and grabbing based on binocular vision

Yi Chun Du, Taryudi Taryudi, Ching Tang Tsai, Ming Shyan Wang

Research output: Contribution to journalArticlepeer-review


This paper aims to study eye-to-hand robotic tracking and grabbing based on binocular vision. Two cameras placed on different locations gave different three-dimensional coordinates of the object from a binocular vision. The robot then analyzed the dynamic vision acquired from the stereo cameras and tracked the object in three-dimensional space utilizing continuously adaptive mean shift (CAMSHIFT) algorithm. Afterward, inverse and forward kinematics were implemented to move the robotic arm to the appropriate position so that it can grab the object using the end effector. The inverse kinematics was analyzed by a geometric algorithm to reduce the computational burden. Consequently, the experimental results verified that the eye-to-hand system was able to track and grasp the target successfully.

Original languageEnglish
JournalMicrosystem Technologies
Publication statusAccepted/In press - 2019

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Hardware and Architecture
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Eye-to-hand robotic tracking and grabbing based on binocular vision'. Together they form a unique fingerprint.

Cite this