Drawing Insights: Sequential Representation Learning in Comics

Open Access
Authors
Publication date 2024
Book title The 35th British Machine Vision Conference
Book subtitle BMVC 2024 : 25th-28th November 2024, Glasgow, UK
Event 35th British Machine Vision Conference, BMVC 2024
Article number 650
Number of pages 13
Publisher BMVA
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract

Comics present images in a sequence, where the spatially presented sequence is key to the narrative storytelling. To understand a comic, a comprehender must learn to encode this sequential nature. For this we present a novel self-supervised sequential representation learning method designed for comics. Our approach capitalises on the sequential structure of comics to incorporate contextual information. We conduct experiments on the TINTIN Corpus of 1,000+ comics from 144 countries, and show that our method outperforms baseline methods on both classification and retrieval tasks. These results affirm the effectiveness of sequential representation learning for comics, and may aid in uncovering new cultural insights within comics.

Document type Conference contribution
Language English
Published at
https://bmvc2024.org/proceedings/650/ (Final published version)
Other links
Downloads
paper-1 (Final published version)
Permalink to this page
Back