论文

面向球面数据的 SO(3) 等变卷积网络:无需重新学习对称性

Learning without relearning physical symmetry: an SO(3)-equivariant convolutional network (CNN) on the sphere

精选理由

一篇让球面物理数据训练省模拟预算的方法:直接把 SO(3) 对称性写进网络结构,宇宙学透镜推断里同预算下 posterior 最紧。

该论文提出一种基于 HEALPix 球面像素化的 gauge equivariant mesh 架构,用 steerable filters、parallel transport 和 spin-weighted 特征构建 SO(3) 等变卷积。网络在给定 band-limit 下具有可证明的精确等变性,SO(3) 不变性误差可控制在百分之一及以下,且由超参数调控。在基准测试中,该方法的稠密梯度回归最准确,CMB 前景去除与去噪成绩具有竞争力。在宇宙学引力透镜的 simulation-based inference(SBI)中,相同模拟次数下该技术给出最紧的 posterior。

原文 · arXiv cs.LG

Learning without relearning physical symmetry: an SO(3)-equivariant convolutional network (CNN) on the sphere

Many of the most important datasets in the physical sciences live natively on the sphere, and these data often carry no preferred position or orientation. Using methods that do not reflect this symmetry leads to far higher simulation requirements, which can be catastrophic for scientific analyses (forcing reliance on cheap, imperfect models that bias results). We present a novel spherical implementation of a gauge equivariant mesh architecture that is specifically designed for the Hierarchical Equal Area isoLatitude Pixelization (\healpix{}) of the sphere. The $\mathrm{SO}(3)$-equivariant convolution is built from steerable filters, parallel transport and spin-weighted features. The architecture supplies the exact symmetry, so the network does not spend training data learning it. The convolution operations are constructed to give provably exact equivariance, given a band-limit. Our full CNNs can achieve SO(3)-invariance error at per-cent-level and lower, which is controlled through well-understood hyperparameters. On benchmarks, our technique gives the most accurate dense gradient regression and competitive cosmic microwave background foreground removal and denoising. The improved simulation efficiency matters most in simulation-based inference (SBI), where high-fidelity simulations are expensive and neural compressors require large training sets, so a fixed budget forces analyses with less accurate simulators. In cosmology lensing SBI, our technique yields the tightest posteriors at matched simulation count. This approach is a novel method that will enable new convolutional neural network analyses, including generative and inference tasks, for processes and data on the sphere.