← Search

Junfeng Shen

3 accepted papers

2025

HMoRA: Making LLMs More Effective with Hierarchical Mixture of LoRA Experts

ICLR 2025poster

Recent studies have combined Mixture of Experts (MoE) and Parameter-Efficient Fine-tuning (PEFT) to fine-tune large language models (LLMs), holding excellent performance in multi-task scenarios while remaining resource-efficient. However, existing MoE approaches still exhibit the following limitati…

2025

STD-PLM: Understanding Both Spatial and Temporal Properties of Spatial-Temporal Data with PLM

AAAI 2025technical

Spatial-temporal forecasting and imputation are important for real-world intelligent systems. Most existing methods are tailored for individual forecasting or imputation tasks but are not designed for both. Additionally, they are less effective for zero-shot and few-shot learning. While pre-trained…

2023

Towards Enhancing Relational Rules for Knowledge Graph Link Prediction

EMNLP 2023long findings

Graph neural networks (GNNs) have shown promising performance for knowledge graph reasoning. A recent variant of GNN called progressive relational graph neural network (PRGNN), utilizes relational rules to infer missing knowledge in relational digraphs and achieves notable results. However, during r…

Cited by 0SourcecodeScholar