ShuaiZhao

Can LLMs Reason Soundly in Law? Auditing Inference Patterns for Legal Judgment

This paper presents a method to analyze the inference patterns used by Large Language Models (LLMs) for judgment in a case study on legal LLMs, so as to identify potential incorrect representations of the LLM, according to human domain knowledge. Unlike traditional evaluations on language generation…