Material handling of a mobile manipulator using an eye-in-hand vision system

T. I.James Tsay, Y. F. Lai, Y. L. Hsiao

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

The developed mobile manipulator is primarily composed of a mobile base, a robot manipulator and an eye-in-hand vision system. The material handling of a mobile manipulator has two stages: guiding the mobile base between stations, and picking up a workpiece from a station. Fast landmark recognition and obstacle detection based on color segmentation are proposed for path following, obstacle avoidance and mobile base positioning. Using the machine vision, a vision-based vector field histogram method is modified and applied to guide the mobile manipulator for obstacle avoidance. However, after the mobile manipulator arrives at the station, positioning errors of the mobile base and the non-horizontality of ground inevitably cause position and orientation errors of the mobile base relative to the station. A vision-guided control strategy with a behavior-based look-and-move structure is presented. This strategy is based on six predefined image features. In the designed neural fuzzy controllers, each image feature is taken to generate intuitively one degree of freedom motion command relative to the camera coordinate frame using fuzzy rules, which define a specific visual behavior. These behaviors are then combined and executed in turns to perform grasping tasks.

Original languageEnglish
Title of host publicationIEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010 - Conference Proceedings
Pages4743-4748
Number of pages6
DOIs
Publication statusPublished - 2010 Dec 1
Event23rd IEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010 - Taipei, Taiwan
Duration: 2010 Oct 182010 Oct 22

Publication series

NameIEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010 - Conference Proceedings

Other

Other23rd IEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010
CountryTaiwan
CityTaipei
Period10-10-1810-10-22

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Human-Computer Interaction
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'Material handling of a mobile manipulator using an eye-in-hand vision system'. Together they form a unique fingerprint.

Cite this