SSCM: Self-Supervised Critical Model for Reducing Hallucinations in Chinese Financial Text Generation

Abstract

Large Language Models (LLMs) show strong performance in natural language processing tasks, but their application in the financial domain is limited. Current methods rely on large datasets and manual prompt engineering, resulting in high data demands, long inference times, and frequent hallucinations. To address these limitations, we propose a novel self-supervised prompt optimization framework tailored for the financial domain. Our approach involves training a critical model that evaluates and ranks generated outputs using both good and bad answers generated from various revised prompts. Experiments on a large Chinese financial corpus show that our framework significantly improves performance on tasks such as summarization and event-based question answering, as evidenced by higher scores on both automated metrics like ROUGE, BLEU, and BERTScore, and also through human evaluations. These results validate the effectiveness of our method in reducing hallucinations and improving the quality of financial text generation.