Title: Wide Angle Virtual View Synthesis Using Two-by-Two Kinect V2
Authors: Chang, Huan-Rui
Hang, Hsueh-Ming
電子工程學系及電子研究所
Department of Electronics Engineering and Institute of Electronics
Issue Date: 1-Jan-2017
Abstract: In this piper, we propose a wide-angle view synthesis system based on captured multiple images and depth maps. We use a two-by-two array of Kinect v2 cameras to facilitate virtual camera tilt and zoom-in cases. We integrate two essential components developed by our lab colleagues to form a complete and practical system Two additional elements are designed and implemented in this study. The first element is an improved multi-view blending algorithm that provides a clear improvement on the synthesized image quality even though the warping process induces some artifacts. By using four RGB-D cameras to capture the reference views, we haw sufficient information to decide which pixel in the warped views is erroneous and we replace it by choosing the correct virtual color pixel from the other warped views to generate the synthesized pixel. The second element is solving the asynchronization problem among multiple Kinects in capturing images/videos. For simplicity, our first attempt is implementing a clock calibration system based on PC clock synchronization software. We examine the quality of synthesized views for various camera tilt and zoom-in/out cases. Experimental results show that the proposed multi-view blending algorithm achieves good synthesized image subjective quality on the real world images captured by four Kinect v2 sensors.
URI: http://hdl.handle.net/11536/146970
ISSN: 2309-9402
Journal: 2017 ASIA-PACIFIC SIGNAL AND INFORMATION PROCESSING ASSOCIATION ANNUAL SUMMIT AND CONFERENCE (APSIPA ASC 2017)
Begin Page: 1083
End Page: 1091
Appears in Collections:Conferences Paper