Global Image Representation Using Locality-constrained Linear Coding for Large-Scale Image Retrieval

Abstract

This paper proposes a global image representation based on Locality-constrained Linear Coding (LLC), with an aim to simplify the encoding process of local descriptors so as to facilitate large-scale image retrieval. Starting from the state-of-the-art Fisher Vector (FV) representation, we replace the computation of sophisticated posterior probabilities with simpler LLC. We then conduct several empirical studies to investigate the effects and benefits of this change and to adapt the other terms in FV for a better trade-off between performance and complexity. The result is a simpler global descriptor that combines the merits of both FV and LLC. Experimental results show that when compared with other similar works, our scheme not only brings performance benefits in mean Average Precision, but also offer complexity advantages.