Johannes Hagemann

TOPLOC: A Locality Sensitive Hashing Scheme for Trustless Verifiable Inference

Large language models (LLMs) have proven to be very capable, but access to frontier models currently relies on inference providers. This introduces trust challenges: how can we be sure that the provider is using the model configuration they claim? We propose TOPLOC, a novel method for verifiable inf…