← Search

Mengqi Zhang

15 accepted papers

2026

Disentangling Knowledge Representations for Large Language Model Editing

ICLR 2026poster

Knowledge Editing has emerged as a promising solution for efficiently updating embedded knowledge in large language models (LLMs). While existing approaches demonstrate effectiveness in integrating new knowledge and preserving the original capabilities of LLMs, they fail to maintain fine-grained irr…

Cited by 0SourceScholar
2025

ExcluIR: Exclusionary Neural Information Retrieval

AAAI 2025technical

Exclusion is an important and universal linguistic skill that humans use to express what they do not want. There is little research on exclusionary retrieval, where users express what they do not want to be part of the results produced for their queries. We investigate the scenario of exclusionary r…

2025

KELE: Residual Knowledge Erasure for Enhanced Multi-hop Reasoning in Knowledge Editing

EMNLP 2025

Large language models (LLMs) face challenges with internal knowledge inaccuracies and outdated information. Knowledge editing has emerged as a pivotal approach to mitigate these issues. Although current knowledge editing techniques exhibit promising performance in single-hop reasoning tasks, they sh

Cited by 0SourcePDFScholar
2025

UIPE: Enhancing LLM Unlearning by Removing Knowledge Related to Forgetting Targets

EMNLP 2025

Large Language Models (LLMs) inevitably acquire harmful information during training on massive datasets. LLM unlearning aims to eliminate the influence of such harmful information while maintaining the model’s overall performance. Existing unlearning methods, represented by gradient ascent-based app

Cited by 0SourcePDFScholar
2025

Uncovering Overfitting in Large Language Model Editing

ICLR 2025spotlight

Knowledge editing has been proposed as an effective method for updating and correcting the internal knowledge of Large Language Models (LLMs). However, existing editing methods often struggle with complex tasks, such as multi-hop reasoning. In this paper, we identify and investigate the phenomenon o…

Cited by 7SourcePDFScholar
2024

HOIDiffusion: Generating Realistic 3D Hand-Object Interaction Data

CVPR 2024poster

3D hand-object interaction data is scarce due to the hardware constraints in scaling up the data collection process. In this paper we propose HOIDiffusion for generating realistic and diverse 3D hand-object interaction data. Our model is a conditional diffusion model that takes both the 3D hand-obje…

2024

Knowledge Graph Enhanced Large Language Model Editing

EMNLP 2024main

Large language models (LLMs) are pivotal in advancing natural language processing (NLP) tasks, yet their efficacy is hampered by inaccuracies and outdated knowledge. Model editing emerges as a promising solution to address these challenges. However, existing editing methods struggle to track and inc…

2024

MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning

ACL 2024long

Parameter-efficient fine-tuning (PEFT) is a popular method for tailoring pre-trained large language models (LLMs), especially as the models’ scale and the diversity of tasks increase. Low-rank adaptation (LoRA) is based on the idea that the adaptation process is intrinsically low-dimensional, i.e.,…

2024

MeshFormer : High-Quality Mesh Generation with 3D-Guided Reconstruction Model

NeurIPS 2024oral

Open-world 3D reconstruction models have recently garnered significant attention. However, without sufficient 3D inductive bias, existing methods typically entail expensive training costs and struggle to extract high-quality 3D meshes. In this work, we introduce MeshFormer, a sparse-view reconstruct…

2024

Patched Denoising Diffusion Models For High-Resolution Image Synthesis

ICLR 2024poster

We propose an effective denoising diffusion model for generating high-resolution images (e.g., 1024$\times$512), trained on small-size image patches (e.g., 64$\times$64). We name our algorithm Patch-DM, in which a new feature collage strategy is designed to avoid the boundary artifact when synthesiz…

2024

Self-Supervised Position Debiasing for Large Language Models

ACL 2024findings

Fine-tuning has been demonstrated to be an effective method to improve the domain performance of large language models (LLMs). However, LLMs might fit the dataset bias and shortcuts for prediction, leading to poor generation performance. Previous works have proven that LLMs are prone to exhibit posi…

2023

Context-Aware Deep Reinforcement Learning for Autonomous Robotic Navigation in Unknown Area

CoRL 2023poster

Mapless navigation refers to a challenging task where a mobile robot must rapidly navigate to a predefined destination using its partial knowledge of the environment, which is updated online along the way, instead of a prior map of the environment. Inspired by the recent developments in deep reinfor…

Cited by 25SourceScholar
2023

Learning Latent Relations for Temporal Knowledge Graph Reasoning

ACL 2023long

Temporal Knowledge Graph (TKG) reasoning aims to predict future facts based on historical data. However, due to the limitations in construction tools and data sources, many important associations between entities may be omitted in TKG. We refer to these missing associations as latent relations. Most…

2022

MetaTKG: Learning Evolutionary Meta-Knowledge for Temporal Knowledge Graph Reasoning

EMNLP 2022main

Reasoning over Temporal Knowledge Graphs (TKGs) aims to predict future facts based on given history. One of the key challenges for prediction is to learn the evolution of facts. Most existing works focus on exploring evolutionary information in history to obtain effective temporal embeddings for ent…

Cited by 19SourcePDFScholar