標題: Motion Manipulation for Characters in Videos
作者: Chu, Hung-Kuo
Yeh, Che-Hua
Tang, Nick C.
Tyan, Hsiao-Rong
Wang, Yu-Shuen
Liao, Hong-Yuan Mark
資訊工程學系
Department of Computer Science
關鍵字: Motion characterization;Music Emotion;Motion manipulation
公開日期: 2015
摘要: Multimedia content creation and manipulation have attracted great attention in recent years due to the popularity of mobile image and video capturing devices. In our daily life, the most common subject appearing in the captured content are people. Hence, to create images and videos by manipulating appearances or motions of the human character inside these media becomes an important research issue. In this paper, we propose a novel idea that requires the fusion of video and audio intelligence. We develop a system whose inputs are a monocular video captured by a stationary RGBD sensor and a music clip. In the context of a human character performing a music conducting motion, the output is a re-targeted video where the motion of performer is manipulated according to the emotional cues extracted from the music clip. To achieve this goal, our system is decomposed into three major stages. First, one needs to access to the geometric and appearance information pertaining to meaningful and representative targets in the video sequence. Second, a systematic way is needed to reliably classify and identify important emotions from the music. Third, to complete the emotion transfer, one has to manipulate the video targets based on the extracted music emotions.
URI: http://hdl.handle.net/11536/135999
ISBN: 978-1-4673-9606-6
期刊: 2015 CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI)
起始頁: 512
結束頁: 516
Appears in Collections:Conferences Paper