University of AmsterdamUniversity of AmsterdamUvA

  • Terms of use
  • Contact

UvA-DARE (Digital Academic Repository)

  • Home
  • Advanced Search
  • Browse
  • My selection

Search UvA-DARE

Author
M. Jain
J.C. van Gemert
T. Mensink
C.G.M. Snoek
Year
2015
Title
Objects2action: Classifying and localizing actions without any video example
Event
ICCV 2015: IEEE International Conference on Computer Vision
Book/source title
Proceedings: 2015 IEEE International Conference on Computer Vision: 11-18 December 2015, Santiago, Chile
Pages (from-to)
4588-4596
Publisher
Los Alamitos, CA: IEEE Computer Society
ISBN
9781467383905
Document type
Conference contribution
Faculty
Faculty of Science (FNWI)
Institute
Informatics Institute (IVI)
Abstract
The goal of this paper is to recognize actions in video without the need for examples. Different from traditional zero-shot approaches we do not demand the design and specification of attribute classifiers and class-to-attribute mappings to allow for transfer from seen classes to unseen classes. Our key contribution is objects2action, a semantic word embedding that is spanned by a skip-gram model of thousands of object categories. Action labels are assigned to an object encoding of unseen video based on a convex combination of action and object affinities. Our semantic embedding has three main characteristics to accommodate for the specifics of actions. First, we propose a mechanism to exploit multiple-word descriptions of actions and objects. Second, we incorporate the automated selection of the most responsive objects per action. And finally, we demonstrate how to extend our zero-shot approach to the spatio-temporal localization of actions in video. Experiments on four action datasets demonstrate the potential of our approach.
URL
go to publisher's site
Language
English
Permalink
http://hdl.handle.net/11245/1.488889
Downloads
  • JainICCV2015

Disclaimer/Complaints regulations

If you believe that digital publication of certain material infringes any of your rights or (privacy) interests, please let the Library know, stating your reasons. In case of a legitimate complaint, the Library will make the material inaccessible and/or remove it from the website. Please Ask the Library, or send a letter to: Library of the University of Amsterdam, Secretariat, Singel 425, 1012 WP Amsterdam, The Netherlands. You will be contacted as soon as possible.

PrintPrint this pageShareShare via emailShare on facebookShare on linkedinShare on twitter
  • University library
  • About UvA-DARE
  • Disclaimer
Copyright UvA 2014