Adaptive Mesh-Quantization for Neural PDE Solvers

Open Access
Authors
Publication date 11-2025
Journal Transactions on Machine Learning Research
Article number 5469
Volume | Issue number 2025
Number of pages 21
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract
Physical systems commonly exhibit spatially varying complexity, presenting a significant challenge for neural PDE solvers. While Graph Neural Networks can handle the irregular meshes required for complex geometries and boundary conditions, they still apply uniform computational effort across all nodes regardless of the underlying physics complexity. This leads to inefficient resource allocation where computationally simple regions receive the same treatment as complex phenomena. We address this challenge by introducing Adaptive Mesh Quantization: spatially adaptive quantization across mesh node, edge and cluster features, dynamically adjusting the bit-width used by a quantized model. We propose an adaptive bit-width allocation strategy driven by a lightweight auxiliary model that identifies high-loss regions in the input mesh. This enables dynamic resource distribution in the main model, where regions of higher difficulty are allocated increased bit-width, optimizing computational resource utilization. We demonstrate our framework’s effectiveness by integrat-ing it with two state-of-the-art models, MP-PDE and GraphViT, to evaluate performance across multiple tasks: 2D Darcy flow, large-scale unsteady fluid dynamics in 2D, steady-state Navier–Stokes simulations in 3D, and a 2D hyper-elasticity problem. Our framework demonstrates consistent Pareto improvements over uniformly quantized baselines, yielding up to 50% improvements in performance at the same cost.
Document type Article
Language English
Published at https://openreview.net/forum?id=NN17y897WG
Other links https://github.com/Winfriedvdd/AMQ http://jmlr.org/tmlr/papers/ https://www.scopus.com/pages/publications/105024845282
Downloads
Permalink to this page
Back