Online rate control for video streams

Abstract

A mechanism for varying the frame rate of pre-encoded video clips online is described. The mechanism relies on two different encoders. An offline encoder creates a high-quality bit stream encoded at 30 fps, as well as separate files containing motion vectors for the same clip at lower frame rates. An online encoder decodes the bit stream (if necessary) and re-encodes it at lower frame rates in real time using the precomputed, stored motion information. Online frame rate control, used in conjunction with dynamic bit rate control, allows clients to solve the rate mismatch between the bandwidth available to them and the bit rate of the pre-encoded bit stream. Clients can therefore choose the amount of trade-off between temporal and spatial quality while resolving the rate mismatch problem. Moreover, online frame rate control provides a natural means for implementing a VCR-like fast forward control for video streaming applications, without increasing bandwidth consumption.