CENTRAL AND NONCENTRAL LIMIT THEOREMS ARISING FROM THE SCATTERING TRANSFORM AND ITS NEURAL ACTIVATION GENERALIZATION

Gi Ren Liu, Yuan Chung Sheu, Hau Tieng Wu

研究成果: Article同行評審

摘要

Motivated by the analysis of complicated time series, we examine a generalization of the scattering transform that includes broad neural activation functions. This generalization is the neural activation scattering transform (NAST). NAST comprises a sequence of "neural processing units," each of which applies a high pass filter to the input from the previous layer followed by a composition with a nonlinear function as the output to the next neuron. Here, the nonlinear function models how a neuron gets excited by the input signal. In addition to showing properties like nonexpansion, horizontal translational invariability, and insensitivity to local deformation, we explore the statistical properties of the second-order NAST of a Gaussian process with various dependence structures and its interaction with the chosen wavelets and activation functions. We also provide central limit theorem (CLT) and non-CLT results. Numerical simulations demonstrate the developed theorems. Our results explain how NAST processes complicated time series, paving a way toward statistical inference based on NAST for real-world applications.

原文English
頁(從 - 到)1170-1213
頁數44
期刊SIAM Journal on Mathematical Analysis
55
發行號2
DOIs
出版狀態Published - 2023 4月

All Science Journal Classification (ASJC) codes

  • 分析
  • 計算數學
  • 應用數學

指紋

深入研究「CENTRAL AND NONCENTRAL LIMIT THEOREMS ARISING FROM THE SCATTERING TRANSFORM AND ITS NEURAL ACTIVATION GENERALIZATION」主題。共同形成了獨特的指紋。

引用此