标题: Real-Time Fingerspelling Recognition System Design Based on RGB-D Image Information
作者: Chou, Kuan-Yu
Chuang, Hui-Chi
Chiu, Meng-Tzu
Chen, Yon-Ping
电控工程研究所
Institute of Electrical and Control Engineering
关键字: fingerspelling recognition;gesture recognition
公开日期: 2014
摘要: This paper provides a fingerspelling recognition system with high accuracy rate based on RGB-D image. The system are separated into three parts, including hand region detection, hand feature extraction, and fingerspelling recognition. For the hand regions detection, the regions of hand and face are first obtained by skin color detection and connect component labeling (CCL), and then the hand, the region-of-interest (ROI), is determined by the feature point extraction based on distance transform. Followed is the hand feature extraction which consists of the hand structure and the hand texture. From the feature points of ROI, the locations of palm and fingertips, palm direction, and finger vectors are formed as the hand structure. In addition to the hand structure, this paper adopts the LBP operator to generate the hand texture to deal with the fingerspelling not recognizable by the hand structure. Finally, the extracted hand features are sent into the fingerspelling recognition system, which is built with several different neural network classifiers. The experimental results show that this system is an effective real-time recognition system whose accuracy is higher than 80% for most of the fingerspelling in American Sign Language (ASL).
URI: http://hdl.handle.net/11536/135856
ISBN: 978-1-4799-4584-9
期刊: 2014 CACS INTERNATIONAL AUTOMATIC CONTROL CONFERENCE (CACS 2014)
起始页: 75
结束页: 80
显示于类别:Conferences Paper