Owen Ho Wan Yeung

Cluster-Norm for Unsupervised Probing of Knowledge

The deployment of language models brings challenges in generating reliable text, especially when these models are fine-tuned with human preferences. To extract the encoded knowledge in these models without (potentially) biased human labels, unsupervised probing techniques like Contrast-Consistent Se…