Gradient field descriptor for sketch based retrieval and localization

Hu, Rui, Barnard, Mark and Collomosse, John (2010) Gradient field descriptor for sketch based retrieval and localization. In: IEEE International Conference on Image Processing; 12 - 15 Sep 2010, Hong Kong, Hong Kong.

Official URL: https://doi.org/10.1109/ICIP.2010.5649331

Abstract

We present an image retrieval system driven by free-hand sketched queries depicting shape. We introduce Gradient Field HoG (GF-HOG) as a depiction invariant image descriptor, encapsulating local spatial structure in the sketch and facilitating efficient codebook based retrieval. We show improved retrieval accuracy over 3 leading descriptors (Self Similarity, SIFT, HoG) across two datasets (Flickr160, ETHZ extended objects), and explain how GF-HOG can be combined with RANSAC to localize sketched objects within relevant images. We also demonstrate a prototype sketch driven photo montage application based on our system.

Actions (Repository Editors)

Item Control Page