Piles of Objects Detection for Grasping System Using Modified RGB-D MobileNetV3

Bor Haur Lin, Wei He, Kai Jung Shih, Chih Hung G. Li, Jenn Jier James Lien

研究成果: Conference contribution

摘要

In modern industrial and production environments, robots are playing an increasingly important role. The combination of machine vision and robotic arms has shown great advantages in various automated processes. Automatic grasping using robotic arms can effectively reduce labor costs, improve efficiency, and make management easier. With this trend, more and more applications are emerging, such as high-precision parts processing and logistics warehousing and transshipment. However, enabling robots to have grasping capabilities still faces challenges. Humans can easily perceive and grasp objects in space, but for robots, how to perceive the ever-changing shapes and postures of objects from environmental information, safety and flexibly adapt to specific rules (such as objects with offset centers of gravity must be grasped near the center of gravity, fragile positions of objects cannot be grasped), generate corresponding grasping strategies and maintain sufficient success rate is our research focus. This study uses deep learning methods to design an automated mechanical grasping system that combines RGB-D cameras, machine vision, and robotic arms. The proposed network architecture is to use MobileNetV3 to extract global features of color images and depth images, and finally generate the grasping strategy of the robotic arm, outputting the position and rotation angle of the object. Finally, test the accuracy and success rate of grasping in a real environment. The success rate of our method in Wood datasets and BinObjects datasets can be above 90%.

原文English
主出版物標題2023 International Conference on Advanced Robotics and Intelligent Systems, ARIS 2023
發行者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子)9798350302714
DOIs
出版狀態Published - 2023
事件2023 International Conference on Advanced Robotics and Intelligent Systems, ARIS 2023 - Taipei, Taiwan
持續時間: 2023 8月 302023 9月 1

出版系列

名字International Conference on Advanced Robotics and Intelligent Systems, ARIS
2023-August
ISSN(列印)2374-3255
ISSN(電子)2572-6919

Conference

Conference2023 International Conference on Advanced Robotics and Intelligent Systems, ARIS 2023
國家/地區Taiwan
城市Taipei
期間23-08-3023-09-01

All Science Journal Classification (ASJC) codes

  • 控制與系統工程
  • 人工智慧

指紋

深入研究「Piles of Objects Detection for Grasping System Using Modified RGB-D MobileNetV3」主題。共同形成了獨特的指紋。

引用此