Grid-Functioned Neural Networks
Javier Dehesa, Andrew Vidler, Julian Padget, Christof Lutteroth
Abstract
We introduce a new neural network architecture that we call "grid-functioned" neural networks. It utilises a grid structure of network parameterisations that can be specialised for different subdomains of the problem, while maintaining smooth, continuous behaviour. The grid gives the user flexibility to prevent gross features from overshadowing important minor ones. We present a full characterisation of its computational and spatial complexity, and demonstrate its potential, compared to a traditional architecture, over a set of synthetic regression problems. We further illustrate the benefits through a real-world 3D skeletal animation case study, where it offers the same visual quality as a state-of-the-art model, but with lower computational complexity and better control accuracy.
BibTeX
@InProceedings{pmlr-v139-dehesa21a,
title = {Grid-Functioned Neural Networks},
author = {Dehesa, Javier and Vidler, Andrew and Padget, Julian and Lutteroth, Christof},
booktitle = {Proceedings of the 38th International Conference on Machine Learning},
pages = {2559--2567},
year = {2021},
editor = {Meila, Marina and Zhang, Tong},
volume = {139},
series = {Proceedings of Machine Learning Research},
month = {18--24 Jul},
publisher = {PMLR},
pdf = {http://proceedings.mlr.press/v139/dehesa21a/dehesa21a.pdf},
url = {https://proceedings.mlr.press/v139/dehesa21a.html},
abstract = {We introduce a new neural network architecture that we call "grid-functioned" neural networks. It utilises a grid structure of network parameterisations that can be specialised for different subdomains of the problem, while maintaining smooth, continuous behaviour. The grid gives the user flexibility to prevent gross features from overshadowing important minor ones. We present a full characterisation of its computational and spatial complexity, and demonstrate its potential, compared to a traditional architecture, over a set of synthetic regression problems. We further illustrate the benefits through a real-world 3D skeletal animation case study, where it offers the same visual quality as a state-of-the-art model, but with lower computational complexity and better control accuracy.}
}