Development of a mobile robot for visually guided handling of material

James Tsing-Iuan Tsay, M. S. Hsu, R. X. Lin

Research output: Contribution to journalConference articlepeer-review

5 Citations (Scopus)


Mobile robots frequently replace humans in handling and transporting wafer carriers in semiconductor production lines. A mobile robot is constructed in this paper. The developed mobile robot is primarily composed of a mobile base, a robot manipulator, and a vision system. Since the guidance control system of the mobile base inevitably causes positioning errors of the mobile base, this study employs the eye-in-hand vision system to provide visual information for controlling the manipulator of the mobile robot to grasp accurately stationary material during pick-and-place operations between a predefined station and the mobile robot. This work further proposes a position-based look-and-move task encoding control strategy for eye-in-hand vision architecture, that maintains all target features in the camera's field of view throughout the visual guiding. Moreover, the manipulator can quickly approach the material and precisely position the end-effector in the desired pose. Numerous techniques are required for implementing such a task, including image enhancement, edge detection, corner and centroid detection, camera model calibration method, robotic hand/eye calibration method, using a camera with controlled zoom and focus, and task encoding scheme. Finally, the theoretical results for the proposed control strategy are experimentally verified on the constructed mobile robot. Specific experimental demonstrations include grasping the target object with different locations on the station and grasping the target object tilted by different angles to the station.

Original languageEnglish
Pages (from-to)3397-3402
Number of pages6
JournalProceedings - IEEE International Conference on Robotics and Automation
Publication statusPublished - 2003 Dec 9
Event2003 IEEE International Conference on Robotics and Automation - Taipei, Taiwan
Duration: 2003 Sept 142003 Sept 19

All Science Journal Classification (ASJC) codes

  • Software
  • Control and Systems Engineering
  • Artificial Intelligence
  • Electrical and Electronic Engineering


Dive into the research topics of 'Development of a mobile robot for visually guided handling of material'. Together they form a unique fingerprint.

Cite this