Title: | Speaker attention system for mobile robots using microphone array and face tracking |
Authors: | Song, Kai-Tai Hu, Jwu-Sheng Tsai, Chi-Yi Chou, Chung-Min Cheng, Chieh- Cheng Liu, Wei-Han Yang, Chia-Hsing 電控工程研究所 Institute of Electrical and Control Engineering |
Keywords: | human-robot interaction;DOA;speech enhancement;real-time face tracking;illumination variation |
Issue Date: | 2006 |
Abstract: | This paper presents a real-time human-robot interface system (HRIS), which processes both speech and vision information to improve the quality of communication between human and an autonomous mobile robot. The HRIS contains a real-time speech attention system and a real-time face tracking system. In the speech attention system, a microphone-array voice acquisition system has been developed to estimate the direction of speaker and purify the speaker's speech signal in a noisy environment. The developed face tracking system aims to track the speaker's face under illumination variation and react to the face motion. The proposed HRIS can provide a robot with the abilities of finding a speaker's direction, tracking the speaker's face, moving its body to the speaker, focusing its attention to the speaker who is talking to it, and purifying the speaker's speech. The experimental results show that the HRIS not only purifies speech signal with a significant performance, but also tracks a face under illumination variation in real-time. |
URI: | http://hdl.handle.net/11536/17215 |
ISBN: | 0-7803-9505-0 |
ISSN: | 1050-4729 |
Journal: | 2006 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-10 |
Begin Page: | 3624 |
End Page: | 3629 |
Appears in Collections: | Conferences Paper |