AIConfPaper
← Search

Lingfeng Xu

2 accepted papers

2025

The Impact of Decorrelation on Transformer Interpretation Methods: Applications to Clinical Speech AI

Lingfeng Xu, Kimberly D. Mueller, Julie Liss, Visar Berisha
ICASSP 2025accepted

Recent applications of decorrelation methods to the multi-head attention layers and output embeddings of transformer-based models have resulted in improvements in efficiency and accuracy. Despite these advancements, there is a lack of research focused on the influence of decorrelation on transformer…

Cited by 0Source ↗Scholar ↗
2023

Decorrelating Language Model Embeddings for Speech-Based Prediction of Cognitive Impairment

Lingfeng Xu, Kimberly D. Mueller, Julie Liss, Visar Berisha
ICASSP 2023accepted

Training robust clinical speech-based models that generalize requires large sample sizes because speech is variable and high-dimensional. Researchers have turned to foundational models, such as the Bidirectional Encoder Representations from Transformers (BERT), to generate lower-dimensional embeddin…

Cited by 0Source ↗Scholar ↗