Edge-and-motion-based semantic video object extraction and application to scene composition

Abstract

We consider automatic segmentation of natural video for content-based video applications. In particular, we present a segmentation algorithm employing both motion and edge information. It employs the edge-linking approach for accurate determination of object boundaries and bidirectional motion estimation for robust tracking of object motion and shape change. The algorithm is designed with computational complexity also in mind. We further consider scene composition using the segmented objects. We, describe and evaluate a method to enlarge or shrink objects for such purpose. The method is amenable to spatial-scalable coding.(1).