Zhenquan Shen

A Compact Model for Mathematics Problem Representations Distilled from BERT

Large language models (LLMs) have made significant advancements in math problem solving, but their large size and high latency render them impractical for real-world applications in intelligent mathematics solvers. Recently, task-agnostic compact models have been developed to replace LLMs in general…