Title: Speaker attention system for mobile robots using microphone array and face tracking
Authors: Song, Kai-Tai
Hu, Jwu-Sheng
Tsai, Chi-Yi
Chou, Chung-Min
Cheng, Chieh- Cheng
Liu, Wei-Han
Yang, Chia-Hsing
電控工程研究所
Institute of Electrical and Control Engineering
Keywords: human-robot interaction;DOA;speech enhancement;real-time face tracking;illumination variation
Issue Date: 2006
Abstract: This paper presents a real-time human-robot interface system (HRIS), which processes both speech and vision information to improve the quality of communication between human and an autonomous mobile robot. The HRIS contains a real-time speech attention system and a real-time face tracking system. In the speech attention system, a microphone-array voice acquisition system has been developed to estimate the direction of speaker and purify the speaker's speech signal in a noisy environment. The developed face tracking system aims to track the speaker's face under illumination variation and react to the face motion. The proposed HRIS can provide a robot with the abilities of finding a speaker's direction, tracking the speaker's face, moving its body to the speaker, focusing its attention to the speaker who is talking to it, and purifying the speaker's speech. The experimental results show that the HRIS not only purifies speech signal with a significant performance, but also tracks a face under illumination variation in real-time.
URI: http://hdl.handle.net/11536/17215
ISBN: 0-7803-9505-0
ISSN: 1050-4729
Journal: 2006 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-10
Begin Page: 3624
End Page: 3629
Appears in Collections:Conferences Paper