Pre-Training on High-Quality Natural Image Data Reduces DCNN Texture Bias
| Authors | |
|---|---|
| Publication date | 2023 |
| Book title | CCN : Conference on Cognitive Computational Neuroscience |
| Book subtitle | Oxford, UK, August 24-27, 2023 |
| Event | 2023 Conference on Cognitive Computational Neuroscience |
| Pages (from-to) | 371-374 |
| Publisher | CCN |
| Organisations |
|
| Abstract |
Deep Convolutional Neural Networks (DCNNs) perform increasingly well on visual tasks like object recognition while also closely aligning with human brain activity.
However, model behaviour also differs from human behaviour in important ways. One prominent example of this difference is that DCNNs trained on ImageNet exhibit a texture bias, while humans are consistently biased towards object shape. Previous work suggests DCNN shape bias can be increased by training on purposely designed stimuli (e.g. stylized images). Here, we present an alternative method that reduces texture bias: pre-training on high-resolution natural images that more closely approximate human visual experience. Our training pipeline needs no data augmentation but solely relies on visual features that occur in everyday scenes. Our method and dataset provide an opportunity to build DCNNs that operate on high-resolution images and may aid in closing the gap between human visual processing and DCNNs. |
| Document type | Conference contribution |
| Language | English |
| Published at | https://doi.org/10.32470/CCN.2023.1294-0 |
| Published at | https://2023.ccneuro.org/view_papera468.html?PaperNum=1294 |
| Downloads |
0000371-1
(Final published version)
|
| Permalink to this page | |
