Special Session 125: Analysis, Algorithms, and Applications of Neural Networks

Neural Networks and Operators Based on Convolution and Multigrid Structure
Juncai He
The King Abdullah University of Science and Technology
Saudi Arabia
Co-Author(s):    Jinchao Xu and Xinliang Liu
Abstract:
In this talk, we will present recent results on applying multigrid structures to both neural networks and operators for problems in images and numerical PDEs. First, we will illustrate MgNet as a unified framework for convolutional neural networks and multigrid methods with some preliminary theories and applications. Then, we will discuss some basic background on operator learning, including the problem setup, a uniform framework, and a general universal approximation result. Motivated by the general definition of neural operators and the MgNet structure, we propose MgNO, which utilizes multigrid structures to parameterize these linear operators between neurons, offering a new and concise architecture in operator learning. This approach provides both mathematical rigor and practical expressivity, with many interesting numerical properties and observations.