Text and image subject classifiers: dense works better

Authors
Publication date 2011
Book title MM '11: proceedings of the 2011 ACM Multimedia Conference & Co-Located Workshops: Nov. 28-Dec. 1, 2011, Scottsdale, AZ, USA
ISBN
  • 9781450306164
Event The 19th ACM international conference on Multimedia
Pages (from-to) 1449-1452
Publisher New York, NY: Association for Computing Machinery
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract
We investigate the feasibility of training visual concept detectors for such abstract subject categories as biology and history with the aim of employing these for full-text to image linking. We show that using dense sampling methods can lead to image classifiers that perform well enough for interactive search. Echoing this dense sampling in the image domain, we also show that using term frequencies as text features outperforms using a topic abstraction method. Finally, we use these monomodal classifiers for the task of linking texts to images, improving more than 50% over the state-of-the-art, thereby showing that dense is better.
Document type Conference contribution
Language English
Published at https://doi.org/10.1145/2072298.2072037
Permalink to this page
Back