An optimization-based equilibrium measure describing fixed points of non-equilibrium dynamics:application to the edge of chaos  

作　　者：Junbin Qiu Haiping Huang 

机构地区：[1]PMI Lab,School of Physics,Sun Yat-sen University,Guangzhou 510275,China [2]Guangdong Provincial Key Laboratory of Magnetoelectric Physics and Devices,Sun Yat-sen University,Guangzhou 510275,China

出　　处：《Communications in Theoretical Physics》2025年第3期140-156,共17页理论物理通讯(英文版)

基　　金：supported by the National Natural Science Foundation of China under Grant No.12122515(HH);Guangdong Provincial Key Laboratory of Magnetoelectric Physics and Devices(Grant No.2022B1212010008);Guangdong Basic and Applied Basic Research Foundation(Grant No.2023B1515040023)。

摘　　要：Understanding neural dynamics is a central topic in machine learning,non-linear physics,and neuroscience.However,the dynamics are non-linear,stochastic and particularly non-gradient,i.e.,the driving force cannot be written as the gradient of a potential.These features make analytic studies very challenging.The common tool is the path integral approach or dynamical mean-field theory.Still,the drawback is that one has to solve the integro-differential or dynamical mean-field equations,which is computationally expensive and has no closed-form solutions in general.From the associated Fokker-Planck equation,the steady-state solution is generally unknown.Here,we treat searching for the fixed points as an optimization problem,and construct an approximate potential related to the speed of the dynamics,and find that searching for the ground state of this potential is equivalent to running approximate stochastic gradient dynamics or Langevin dynamics.Only in the zero temperature limit,can the distribution of the original fixed points be achieved.The resultant stationary state of the dynamics exactly follows the canonical Boltzmann measure.Within this framework,the quenched disorder intrinsic in the neural networks can be averaged out by applying the replica method,which leads naturally to order parameters for the non-equilibrium steady states.Our theory reproduces the well-known result of edge-of-chaos.Furthermore,the order parameters characterizing the continuous transition are derived,and the order parameters are explained as fluctuations and responses of the steady states.Our method thus opens the door to analytically studying the fixed-point landscape of the deterministic or stochastic high dimensional dynamics.

关 键 词：high-dimensional chaos phase transitions neural networks order parameters statistical physics 

分 类 号：O414.2[理学—理论物理]