Garment Detectives: Discovering Clothes and Its Genre in Consumer Photos

Abstract

Clothing image analysis has shown its potential for use in a wide range of applications such as personalized clothing recommendation. Given a consumer photo, this paper addresses the problem of finding clothes and recognizing the genre of that clothes. This problem is very challenging due to large variations of uncontrolled realistic imaging conditions. To tackle these challenges, we formulate a novel framework by integrating local features of multi-modality as the instances of the price-collecting Steiner tree (PCST) problem to discover clothing regions, and exploiting visual style elements to discover the clothing genre. The experimental results show that our fully automatic approach is effective to identify irregular shape of clothing region, and it significantly improves the accuracy of clothing genre recognition for images taken in unconstrained environment.