|
CSME 2020/12
Volume 41 No.6
:
755-762
|
|
Implementation of a Human-Robot Collaboration System Based On Smart Hand Gesture and Speech Recognition
Shang-Liang Chena, Li-Wu Huanga, Chung-Chi Huangb, Feng-Chi Leec, Ho-Chuan Huangd and Chien-Yu Chene
aInstitute of Manufacturing Information and Systems, National Cheng Kung University, Tainan, 70101, R.O.C.
bDepartment of Automation and Control Engineering, Far East University, Tainan, 74448, R.O.C.
cDepartment of Mechatronics Control, Industrial Technology Research Institute, Hsinchu, 310, R.O.C.
dDepartment of Intelligent Commerce, National Kaohsiung University of Applied Sciences, Kaohsiung, 824, R.O.C.
eComputer Science and Information Engineering, National University of Tainan, Tainan, 70005, ROC
|
Abstract:
With the development of artificial intelligence technology, the robot arm will be applied in more fields, undertake more work, and become an important assistant of humans. Especially in the manufacturing industry, if a perfect human-robot cooperation (HRC) model can be developed, in which the engineer is responsible for complex operations and monitoring the production process and the robot arm is responsible for highly repetitive and tiring work, the flexibility of the manufacturing process can be improved, the risk of personnel injury can be reduced, and the production line productivity can be improved. To realize the human-robot collaboration system that can be applied in various fields, the technologies of robot arm control, human-robot interaction (HRI), Radio Frequency Identification, machine-to-machine communication, and automatic speech recognition (ASR), etc. are combined in this research. Besides, the HRC in intelligent manufacturing is taken as the demonstration result of this research. In this application example, the human-robot interaction function is realized through smart hand gesture and speech recognition technology, which enables the user to communicate commands to the robot arm most intuitively and easily. The robot arm can execute specific actions, provide processing prompts, or read corresponding motion control command macros according to different commands, to realize various processing contents required by users.
|
|
Keywords: HRC, deep learning, hand gesture recognition, RFID, ASR.
|
Download PDF
|
|
*Corresponding author; e-mail:
|
©
2020
CSME , ISSN 0257-9731
|