基於智慧手勢和語音辨識實現之人機協作系統

With the development of artificial intelligence technology, the robot arm will be applied in more fields, undertake more work, and become an important assistant of humans. Especially in the manufacturing industry, if a perfect human-robot cooperation (HRC) model can be developed, in which the engineer is responsible for complex operations and monitoring the production process and the robot arm is responsible for highly repetitive and tiring work, the flexibility of the manufacturing process can be improved, the risk of personnel injury can be reduced, and the production line productivity can be improved. To realize the human-robot collaboration system that can be applied in various fields, the technologies of robot arm control, human-robot interaction (HRI), Radio Frequency Identification, machine-to-machine communication, and automatic speech recognition (ASR), etc. are combined in this research. Besides, the HRC in intelligent manufacturing is taken as the demonstration result of this research. In this application example, the human-robot interaction function is realized through smart hand gesture and speech recognition technology, which enables the user to communicate commands to the robot arm most intuitively and easily. The robot arm can execute specific actions, provide processing prompts, or read corresponding motion control command macros according to different commands, to realize various processing contents required by users.