C*-algebra Net: A New Approach Generalizing Neural Network Parameters to C*-algebra
Yuka Hashimoto, Zhao Wang, Tomoko Matsui
Abstract
We propose a new framework that generalizes the parameters of neural network models to $C^*$-algebra-valued ones. $C^*$-algebra is a generalization of the space of complex numbers. A typical example is the space of continuous functions on a compact space. This generalization enables us to combine multiple models continuously and use tools for functions such as regression and integration. Consequently, we can learn features of data efficiently and adapt the models to problems continuously. We apply our framework to practical problems such as density estimation and few-shot learning and show that our framework enables us to learn features of data even with a limited number of samples. Our new framework highlights the potential possibility of applying the theory of $C^*$-algebra to general neural network models.
BibTeX
@InProceedings{pmlr-v162-hashimoto22a,
title = {C*-algebra Net: A New Approach Generalizing Neural Network Parameters to C*-algebra},
author = {Hashimoto, Yuka and Wang, Zhao and Matsui, Tomoko},
booktitle = {Proceedings of the 39th International Conference on Machine Learning},
pages = {8523--8534},
year = {2022},
editor = {Chaudhuri, Kamalika and Jegelka, Stefanie and Song, Le and Szepesvari, Csaba and Niu, Gang and Sabato, Sivan},
volume = {162},
series = {Proceedings of Machine Learning Research},
month = {17--23 Jul},
publisher = {PMLR},
pdf = {https://proceedings.mlr.press/v162/hashimoto22a/hashimoto22a.pdf},
url = {https://proceedings.mlr.press/v162/hashimoto22a.html},
abstract = {We propose a new framework that generalizes the parameters of neural network models to $C^*$-algebra-valued ones. $C^*$-algebra is a generalization of the space of complex numbers. A typical example is the space of continuous functions on a compact space. This generalization enables us to combine multiple models continuously and use tools for functions such as regression and integration. Consequently, we can learn features of data efficiently and adapt the models to problems continuously. We apply our framework to practical problems such as density estimation and few-shot learning and show that our framework enables us to learn features of data even with a limited number of samples. Our new framework highlights the potential possibility of applying the theory of $C^*$-algebra to general neural network models.}
}