The generation and tracking of mesh objects in image sequences

Abstract

In this paper, we propose a new scheme that could automatically generate a hierarchical mesh structure fore real image and then use a nodal block matching to track this mesh structure in an image sequence. First, a three-layer pyramid is built by using a multi-resolution approach. For each layer, after extracting the high-curvature features, a linking procedure and a splitting process are applied to generate a compact set of representative points. By adopting the constrained Delaunay triangulation algorithm, the selected points can be triangulated into meshes. Starting from the coarsest layer to the finest layer, we further eliminate the duplicate nodes and then form a hierarchical mesh structure. Based on the hierarchical mesh structure and the intensity value at the mesh nodes and, we can progressively reconstruct an image with simple linear interpolation. Moreover, the motion of a mesh is tracked using a coarse-to-fine approach to lower the computational complexity.