Enhancing Semantic Consistency of Large Language Models through Model Editing: An Interpretability-Oriented Approach
A Large Language Model (LLM) tends to generate inconsistent and sometimes contradictory outputs when presented with a prompt that has equivalent semantics but is expressed differently from the original prompt. To achieve semantic consistency of an LLM, one of the key approaches is to finetune the mo…