Liqun Shao

Logical Transformers: Infusing Logical Structures into Pre-Trained Language Models

Natural language contains rich logical structures and logical information, and correctly detecting and accurately understanding these logical structures and information underlying natural language texts is very crucial for NLP models’ performance on many important NLU and NLG tasks. Existing pre-tra…