Compression-based similarity

Authors
Publication date 2011
Book title First International Conference on Data Compression, Communication and Processing
Book subtitle CCP 2011 : Palinuro, Cilento Coast, Italy, 21-24 June 2011 : proceedings
ISBN
  • 9781457714580
ISBN (electronic)
  • 9780769545288
Event 1st International Conference on Data Compression, Communication, and Processing, CCP 2011
Pages (from-to) 111-118
Number of pages 8
Publisher Piscataway, NJ : IEEE
Organisations
  • Interfacultary Research - Institute for Logic, Language and Computation (ILLC)
Abstract

First we consider pair-wise distances for literal objects consisting of finite binary files. These files are taken to contain all of their meaning, like genomes or books. The distances are based on compression of the objects concerned, normalized, and can be viewed as similarity distances. Second, we consider pair-wise distances between names of objects, like "red" or "christianity." In this case the distances are based on searches of the Internet. Such a search can be performed by any search engine that returns aggregate page counts. We can extract a code length from the numbers returned, use the same formula as before, and derive a similarity or relative semantics between names for objects. The theory is based on Kolmogorov complexity. We test both similarities extensively experimentally.

Document type Conference contribution
Note Invited lecture.
Language English
Published at https://doi.org/10.1109/CCP.2011.50
Other links https://www.scopus.com/pages/publications/81255164944
Permalink to this page
Back