Blind Dates: Examining the Expression of Temporality in Historical Photographs

Open Access
Authors
Publication date 2023
Host editors
  • A. Šeļa
  • F. Jannidis
  • I. Romanowska
Book title Proceedings of the Computational Humanities Research Conference 2023
Book subtitle Paris, France, December 6-8, 2023
Series CEUR Workshop Proceedings
Event 2023 Computational Humanities Research Conference, CHR 2023
Pages (from-to) 490-499
Number of pages 10
Publisher Aachen: CEUR-WS
Organisations
  • Faculty of Humanities (FGw) - Amsterdam Institute for Humanities Research (AIHR) - Amsterdam School of Historical Studies (ASH)
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract

This paper explores the capacity of computer vision models to discern temporal information in visual content, focusing specifically on historical photographs. We investigate the dating of images using OpenCLIP, an open-source implementation of CLIP, a multi-modal language and vision model. Our experiment consists of three steps: zero-shot classification, fine-tuning, and analysis of visual content. We use the De Boer Scene Detection dataset, containing 39,866 gray-scale historical press photographs from 1950 to 1999. The results show that zero-shot classification is relatively ineffective for image dating, with a bias towards predicting dates in the past. Fine-tuning OpenCLIP with a logistic classifier improves performance and eliminates the bias. Additionally, our analysis reveals that images featuring buses, cars, cats, dogs, and people are more accurately dated, suggesting the presence of temporal markers. The study highlights the potential of machine learning models like OpenCLIP in dating images and emphasizes the importance of fine-tuning for accurate temporal analysis. Future research should explore the application of these findings to color photographs and diverse datasets.

Document type Conference contribution
Language English
Published at https://ceur-ws.org/Vol-3558/paper5790.pdf
Other links https://ceur-ws.org/Vol-3558/ https://www.scopus.com/pages/publications/85178655537
Downloads
paper5790 (Final published version)
Permalink to this page
Back