On the Theoretical Limitations of Embedding-based Link Prediction
Neural networks often map low-dimensional embeddings to high-dimensional output spaces. Usually, the output layer is linear, which can create a *rank bottleneck* that limits the functions a model can represent. Such bottlenecks are ubiquitous in link prediction models, such as knowledge graph embedd…