Accelerated Tsetlin Machine Inference Through Incremental Model Re-evaluation

Open Access
Authors
Publication date 2024
Book title 2024 International Symposium on the Tsetlin Machine (ISTM 2024)
Book subtitle Pittsburgh, Pennsylvania, USA, 28-30 August 2024
ISBN
  • 9798331504991
ISBN (electronic)
  • 9798331504984
Event 3rd International Symposium on the Tsetlin Machine, ISTM 2024
Pages (from-to) 93-100
Number of pages 8
Publisher Piscataway, NJ: IEEE
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract

Tsetlin Machines (TMs) are a new class of machine learning algorithms that leverage propositional (Boolean) logic. While ensuring transparent and inherently interpretable decision-making, they handle relatively complex pattern recognition tasks, including classification, convolution, and regression. However, like most machine learning approaches, inference is computationally expensive for large models because each new input requires recalculating the model output from scratch. Slow evaluation can be problematic in time-critical tasks, hindering the deployment of more powerful models. This paper proposes a new TM inference approach that drastically reduces computational complexity through incremental model re-evaluation. To this end, we single out small incremental computations by tracing which clauses are impacted by each input feature. Our tailored solution for TM offers a more scalable and efficient inference strategy, particularly beneficial when new inputs are similar to previous ones. The results of our experiments on benchmark datasets demonstrate that our approach not only retains the same precision as the traditional TM but also provides significantly faster inference, achieving up to a 40 times speedup. The code is made available on GitHub.

Document type Conference contribution
Language English
Published at https://doi.org/10.1109/ISTM62799.2024.10931270
Other links https://www.proceedings.com/79475.html https://www.scopus.com/pages/publications/105002218799
Downloads
Permalink to this page
Back