5 accepted papers
The exponential growth in the parameter scale of Large Language Models (LLMs) has precipitated an urgent demand for efficient compression techniques to facilitate practical deployment. To address this challenge, low-rank decomposition based on Singular Value Decomposition (SVD) offers a principled, …
Pruning has recently been widely adopted to reduce the parameter scale and improve the inference efficiency of Large Language Models (LLMs). Mainstream pruning techniques often rely on uniform layerwise pruning strategies, which can lead to severe performance degradation at high sparsity levels. Rec…
Multi-hop Reading Comprehension (RC) is a challenging task that requires models to integrate dispersed information and perform multi-step reasoning. In recent years, graph-based methods have shown promising performance on multi-hop RC tasks. However, they often overemphasize nodes and connection str…
The application of Large Language Models (LLMs) is rapidly expanding in fields such as natural language processing and computer vision. However, due to the enormous number of model parameters, while their emergent capabilities enhance performance, they also incur significant computational and storag…
Video question answering (VideoQA) has recently gained considerable attention in the field of computer vision, aiming to generate answers rely on both linguistic and visual reasoning. However, existing methods often align visual or textual features directly with large language models, which limits t…