Ball-catching system using image processing and an omni-directional wheeled mobile robot

Sho Tsung Kao, Ming Tzu Ho

Research output: Contribution to journalArticlepeer-review

Abstract

The ball-catching system examined in this research, which was composed of an omni-directional wheeled mobile robot and an image processing system that included a dynamic stereo vision camera and a static camera, was used to capture a thrown ball. The thrown ball was tracked by the dynamic stereo vision camera, and the omni-directional wheeled mobile robot was navigated through the static camera. A Kalman filter with deep learning was used to decrease the visual measurement noises and to estimate the ball’s position and velocity. The ball’s future trajectory and landing point was predicted by estimating its position and velocity. Feedback linearization was used to linearize the omni-directional wheeled mobile robot model and was then combined with a proportional-integral-derivative (PID) controller. The visual tracking algorithm was initially simulated numerically, and then the performance of the designed system was verified experimentally. We verified that the designed system was able to precisely catch a thrown ball.

Original languageEnglish
Article number3208
JournalSensors
Volume21
Issue number9
DOIs
Publication statusPublished - 2021 May 1

All Science Journal Classification (ASJC) codes

  • Analytical Chemistry
  • Information Systems
  • Atomic and Molecular Physics, and Optics
  • Biochemistry
  • Instrumentation
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Ball-catching system using image processing and an omni-directional wheeled mobile robot'. Together they form a unique fingerprint.

Cite this