Browsing by Author "Su, Chih-Wen"

Now showing 1 - 5 of 5

Motion flow-based video retrieval
(2007-10-01)
Su, Chih-Wen
;
Liao, Hong-Yuan Mark
;
Tyan, Hsiao-Rong
;
Lin, Chia-Wen
;
Chen, Duan-Yu
In this paper, we propose the use of motion vectors embedded in MPEG bitstreams to generate so-called "motion flows", which are applied to perform video retrieval. By using the motion vectors directly, we do not need to consider the shape of a moving object and its corresponding trajectory. Instead, we simply "link" the local motion vectors across consecutive video frames to form motion flows, which are then recorded and stored in a video database. In the video retrieval phase, we propose a new matching strategy to execute the video retrieval task. Motions that do not belong to the mainstream motion flows are filtered out by our proposed algorithm. The retrieval process can be triggered by query-by-sketch or query-by-example. The experiment results show that our method is indeed superb in the video retrieval process.
Video Inpainting on Digitized Vintage Films via Maintaining Spatiotemporal Continuity
(2011-08-01)
Tang, Nick C.
;
Hsu, Chiou-Ting
;
Su, Chih-Wen
;
Shih, Timothy K.
;
Liao, Hong-Yuan Mark
Video inpainting is an important video enhancement technique used to facilitate the repair or editing of digital videos. It has been employed worldwide to transform cultural artifacts such as vintage videos/films into digital formats. However, the quality of such videos is usually very poor and often contain unstable luminance and damaged content. In this paper, we propose a video inpainting algorithm for repairing damaged content in digitized vintage films, focusing on maintaining good spatiotemporal continuity. The proposed algorithm utilizes two key techniques. Motion completion recovers missing motion information in damaged areas to maintain good temporal continuity. Frame completion repairs damaged frames to produce a visually pleasing video with good spatial continuity and stabilized luminance. We demonstrate the efficacy of the algorithm on different types of video clips.
VIDEO OBJECT INPAINTING USING POSTURE MAPPING
(2009-01-01)
Ling, Chih-Hung
;
Lin, Chia-Wen
;
Su, Chih-Wen
;
Liao, Hong-Yuan Mark
;
Chen, Yong-Sheng
This paper presents a novel framework for object-based video inpainting. To complete an occluded object, our method first samples a 3-D volume of the video into directional spatio-temporal slices, and then performs patch-based image inpainting to repair the partially damaged object trajectories in the 2-D slices. The completed slices are subsequently combined to obtain a sequence of virtual contours of the damaged object. The virtual contours and a posture sequence retrieval technique are then used to retrieve the most similar sequence of object postures in the available non-occluded postures. Key-posture selection and indexing are performed to reduce the complexity of posture sequence retrieval. We also propose a synthetic posture generation scheme that enriches the collection of key-postures so as to reduce the effect of insufficient key-postures. Our experimental results demonstrate that the proposed method can maintain the spatial consistency and temporal motion continuity of an object simultaneously.
VIDEO OBJECT INPAINTING USING POSTURE MAPPING
(2009-01-01)
Ling, Chih-Hung
;
Lin, Chia-Wen
;
Su, Chih-Wen
;
Liao, Hong-Yuan Mark
;
Chen, Yong-Sheng
This paper presents a novel framework for object-based video inpainting. To complete an occluded object, our method first samples a 3-D volume of the video into directional spatio-temporal slices, and then performs patch-based image inpainting to repair the partially damaged object trajectories in the 2-D slices. The completed slices are subsequently combined to obtain a sequence of virtual contours of the damaged object. The virtual contours and a posture sequence retrieval technique are then used to retrieve the most similar sequence of object postures in the available non-occluded postures. Key-posture selection and indexing are performed to reduce the complexity of posture sequence retrieval. We also propose a synthetic posture generation scheme that enriches the collection of key-postures so as to reduce the effect of insufficient key-postures. Our experimental results demonstrate that the proposed method can maintain the spatial consistency and temporal motion continuity of an object simultaneously.
Virtual Contour Guided Video Object Inpainting Using Posture Mapping and Retrieval
(2011-04-01)
Ling, Chih-Hung
;
Lin, Chia-Wen
;
Su, Chih-Wen
;
Chen, Yong-Sheng
;
Liao, Hong-Yuan Mark
This paper presents a novel framework for object completion in a video. To complete an occluded object, our method first samples a 3-D volume of the video into directional spatio-temporal slices, and performs patch-based image in-painting to complete the partially damaged object trajectories in the 2-D slices. The completed slices are then combined to obtain a sequence of virtual contours of the damaged object. Next, a posture sequence retrieval technique is applied to the virtual contours to retrieve the most similar sequence of object postures in the available non-occluded postures. Key-posture selection and indexing are used to reduce the complexity of posture sequence retrieval. We also propose a synthetic posture generation scheme that enriches the collection of postures so as to reduce the effect of insufficient postures. Our experiment results demonstrate that the proposed method can maintain the spatial consistency and temporal motion continuity of an object simultaneously.