A WWW-based intelligent multimedia information query and retrieve system

Abstract

In this paper, we propose and implement a World Wide Web based video query system: the intelligent Multimedia Information Processing System (IMIPS). The IMIPS first collects videos available over the WWW, analyzes these videos to extract keyframes, and indexes these keyframes at a local database. By using the proposed Multiple-Instance learning algorithm, a user can select a few keyframes to train a desired image query model. When a query model is selected, the proposed IMIPS will retrieve marched images from the local database, and display them as a small icon at the user interface. Then a user can click on the interested icon to retrieve and to play the video from the original web site. According to the implemented prototype system, a user can find one's desired videos on the WWW with only a few (2-3) times of retraining to achieve 70% hit rate on 50 retrieved videos among 5 different query models.