Raj Deshpande

Bound by semanticity: universal laws governing the generalization-identification tradeoff

Intelligent systems must form internal representations that support both broad generalization and precise identification. Here, we show that these two goals are fundamentally in tension with one another. We derive closed-form expressions proving that any model whose representations have a finite s…