Ultrahyperbolic Representation Learning
Abstract
In machine learning, data is usually represented in a (flat) Euclidean space where distances between points are along straight lines. Researchers have recently considered more exotic (non-Euclidean) Riemannian manifolds such as hyperbolic space which is well suited for tree-like data. In this paper, we propose a representation living on a pseudo-Riemannian manifold of constant nonzero curvature. It is a generalization of hyperbolic and spherical geometries where the non-degenerate metric tensor need not be positive definite. We provide the necessary learning tools in this geometry and extend gradient method optimization techniques. More specifically, we provide closed-form expressions for distances via geodesics and define a descent direction to minimize some objective function. Our novel framework is applied to graph representations.
BibTeX
@inproceedings{NEURIPS2020_123b7f02,
author = {Law, Marc and Stam, Jos},
booktitle = {Advances in Neural Information Processing Systems},
editor = {H. Larochelle and M. Ranzato and R. Hadsell and M.F. Balcan and H. Lin},
pages = {1668--1678},
publisher = {Curran Associates, Inc.},
title = {Ultrahyperbolic Representation Learning},
url = {https://proceedings.neurips.cc/paper_files/paper/2020/file/123b7f02433572a0a560e620311a469c-Paper.pdf},
volume = {33},
year = {2020}
}