Object recognition and user interface design for vision-based autonomous robotic grasping point determination

Fang Che Cheng; Chia Ching Yen; Tay Sheng Jeng

doi:10.52842/conf.caadria.2021.1.633

Object recognition and user interface design for vision-based autonomous robotic grasping point determination

Fang Che Cheng
, Chia Ching Yen
, Tay Sheng Jeng

建築學系

研究成果: Conference contribution

5 引文斯高帕斯（Scopus）

摘要

The integration of Robot Operating System (ROS) with Human-Machine Collaboration (HMC) currently represents the future tendency toward Autonomous Robotic In-Situ Assembly on Construction Sites. In comparison with the industrial environment, construction sites nowadays are extremely complex and unpredictable, due to the different building components and customized design.This paper presents a visual-based object recognition method and user interface enabling on-site robot arms to autonomously handle building components, to build specific designs without the influence of material, shape, and environment. The implementation is an object recognition approach that serves with KUKA industrial robotic manipulator along with an RGB-depth stereo camera in an eye-in-hand configuration to grasp and manipulate found elements to build the desired structure. Opportunities for using vision-based autonomous robotic in-situ assembly on construction sites are reviewed.

原文	English
主出版物標題	Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021
編輯	Anastasia Globa, Jeroen van Ameijde, Adam Fingrut, Nayeon Kim, Tian Tian Sky Lo
發行者	The Association for Computer-Aided Architectural Design Research in Asia (CAADRIA)
頁面	633-642
頁數	10
ISBN（電子）	9789887891758
DOIs	https://doi.org/10.52842/conf.caadria.2021.1.633
出版狀態	Published - 2021
事件	26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia: Projections, CAADRIA 2021 - Hong Kong, Hong Kong 持續時間: 2021 3月 29 → 2021 4月 1

出版系列

名字	Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021
卷	1

Conference

Conference	26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia: Projections, CAADRIA 2021
國家/地區	Hong Kong
城市	Hong Kong
期間	21-03-29 → 21-04-01

UN SDG

此研究成果有助於以下永續發展目標

SDG 9 產業、創新與基礎設施

All Science Journal Classification (ASJC) codes

電腦繪圖與電腦輔助設計
建築與營造

存取文件

10.52842/conf.caadria.2021.1.633

其它文件與鏈接

引用此

Cheng, F. C., Yen, C. C., & Jeng, T. S. (2021). Object recognition and user interface design for vision-based autonomous robotic grasping point determination. 於 A. Globa, J. van Ameijde, A. Fingrut, N. Kim, & T. T. S. Lo (編輯), Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021 (頁 633-642). (Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021; 卷 1). The Association for Computer-Aided Architectural Design Research in Asia (CAADRIA). https://doi.org/10.52842/conf.caadria.2021.1.633

Cheng, Fang Che ; Yen, Chia Ching ; Jeng, Tay Sheng. / Object recognition and user interface design for vision-based autonomous robotic grasping point determination. Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021. 編輯 / Anastasia Globa ; Jeroen van Ameijde ; Adam Fingrut ; Nayeon Kim ; Tian Tian Sky Lo. The Association for Computer-Aided Architectural Design Research in Asia (CAADRIA), 2021. 頁 633-642 (Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021).

@inproceedings{3406bffeee004c8d94295391f12b8b90,

title = "Object recognition and user interface design for vision-based autonomous robotic grasping point determination",

abstract = "The integration of Robot Operating System (ROS) with Human-Machine Collaboration (HMC) currently represents the future tendency toward Autonomous Robotic In-Situ Assembly on Construction Sites. In comparison with the industrial environment, construction sites nowadays are extremely complex and unpredictable, due to the different building components and customized design.This paper presents a visual-based object recognition method and user interface enabling on-site robot arms to autonomously handle building components, to build specific designs without the influence of material, shape, and environment. The implementation is an object recognition approach that serves with KUKA industrial robotic manipulator along with an RGB-depth stereo camera in an eye-in-hand configuration to grasp and manipulate found elements to build the desired structure. Opportunities for using vision-based autonomous robotic in-situ assembly on construction sites are reviewed.",

author = "Cheng, \{Fang Che\} and Yen, \{Chia Ching\} and Jeng, \{Tay Sheng\}",

note = "Publisher Copyright: {\textcopyright} 2021 and published by the Association for Computer-Aided Architectural Design Research in Asia (CAADRIA), Hong Kong.; 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia: Projections, CAADRIA 2021 ; Conference date: 29-03-2021 Through 01-04-2021",

year = "2021",

doi = "10.52842/conf.caadria.2021.1.633",

language = "English",

series = "Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021",

publisher = "The Association for Computer-Aided Architectural Design Research in Asia (CAADRIA)",

pages = "633--642",

editor = "Anastasia Globa and \{van Ameijde\}, Jeroen and Adam Fingrut and Nayeon Kim and Lo, \{Tian Tian Sky\}",

booktitle = "Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021",

}

Cheng, FC, Yen, CC & Jeng, TS 2021, Object recognition and user interface design for vision-based autonomous robotic grasping point determination. 於 A Globa, J van Ameijde, A Fingrut, N Kim & TTS Lo (編輯), Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021. Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021, 卷 1, The Association for Computer-Aided Architectural Design Research in Asia (CAADRIA), 頁 633-642, 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia: Projections, CAADRIA 2021, Hong Kong, Hong Kong, 21-03-29. https://doi.org/10.52842/conf.caadria.2021.1.633

Object recognition and user interface design for vision-based autonomous robotic grasping point determination. / Cheng, Fang Che; Yen, Chia Ching ; Jeng, Tay Sheng.
Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021. 編輯 / Anastasia Globa; Jeroen van Ameijde; Adam Fingrut; Nayeon Kim; Tian Tian Sky Lo. The Association for Computer-Aided Architectural Design Research in Asia (CAADRIA), 2021. p. 633-642 (Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021; 卷 1).

研究成果: Conference contribution

TY - GEN

T1 - Object recognition and user interface design for vision-based autonomous robotic grasping point determination

AU - Cheng, Fang Che

AU - Yen, Chia Ching

AU - Jeng, Tay Sheng

PY - 2021

Y1 - 2021

N2 - The integration of Robot Operating System (ROS) with Human-Machine Collaboration (HMC) currently represents the future tendency toward Autonomous Robotic In-Situ Assembly on Construction Sites. In comparison with the industrial environment, construction sites nowadays are extremely complex and unpredictable, due to the different building components and customized design.This paper presents a visual-based object recognition method and user interface enabling on-site robot arms to autonomously handle building components, to build specific designs without the influence of material, shape, and environment. The implementation is an object recognition approach that serves with KUKA industrial robotic manipulator along with an RGB-depth stereo camera in an eye-in-hand configuration to grasp and manipulate found elements to build the desired structure. Opportunities for using vision-based autonomous robotic in-situ assembly on construction sites are reviewed.

AB - The integration of Robot Operating System (ROS) with Human-Machine Collaboration (HMC) currently represents the future tendency toward Autonomous Robotic In-Situ Assembly on Construction Sites. In comparison with the industrial environment, construction sites nowadays are extremely complex and unpredictable, due to the different building components and customized design.This paper presents a visual-based object recognition method and user interface enabling on-site robot arms to autonomously handle building components, to build specific designs without the influence of material, shape, and environment. The implementation is an object recognition approach that serves with KUKA industrial robotic manipulator along with an RGB-depth stereo camera in an eye-in-hand configuration to grasp and manipulate found elements to build the desired structure. Opportunities for using vision-based autonomous robotic in-situ assembly on construction sites are reviewed.

UR - https://www.scopus.com/pages/publications/85104601193

UR - https://www.scopus.com/pages/publications/85104601193#tab=citedBy

U2 - 10.52842/conf.caadria.2021.1.633

DO - 10.52842/conf.caadria.2021.1.633

M3 - Conference contribution

AN - SCOPUS:85104601193

T3 - Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021

SP - 633

EP - 642

BT - Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021

A2 - Globa, Anastasia

A2 - van Ameijde, Jeroen

A2 - Fingrut, Adam

A2 - Kim, Nayeon

A2 - Lo, Tian Tian Sky

PB - The Association for Computer-Aided Architectural Design Research in Asia (CAADRIA)

T2 - 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia: Projections, CAADRIA 2021

Y2 - 29 March 2021 through 1 April 2021

ER -

Cheng FC, Yen CC , Jeng TS. Object recognition and user interface design for vision-based autonomous robotic grasping point determination. 於 Globa A, van Ameijde J, Fingrut A, Kim N, Lo TTS, 編輯, Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021. The Association for Computer-Aided Architectural Design Research in Asia (CAADRIA). 2021. p. 633-642. (Projections - Proceedings of the 26th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2021). doi: 10.52842/conf.caadria.2021.1.633

Object recognition and user interface design for vision-based autonomous robotic grasping point determination

摘要

出版系列

Conference

UN SDG

All Science Journal Classification (ASJC) codes

存取文件

其它文件與鏈接

指紋

引用此