← Search

Zhijie Nie

8 accepted papers

2025

A Text is Worth Several Tokens: Text Embedding from LLMs Secretly Aligns Well with The Key Tokens

ACL 2025long

Text embeddings from large language models (LLMs) have achieved excellent results in tasks such as information retrieval, semantic textual similarity, etc. In this work, we show an interesting finding: when feeding a text into the LLM-based embedder, the obtained text embedding will be able to be al…

Cited by 0SourcePDFScholar
2025

Dynamic Task Vector Grouping for Efficient Multi-Task Prompt Tuning

ACL 2025finding

Multi-task prompt tuning utilizes multiple high-resource source tasks to improve performance on low-source target tasks. Existing approaches transfer the soft prompt trained by combining all source tasks or a single “high-similar” source task one-time-only. However, we find that the optimal transfer…

2025

Momentum Pseudo-Labeling for Weakly Supervised Phrase Grounding

AAAI 2025technical

Weakly supervised phrase grounding tasks aim to learn alignments between phrases and regions with coarse image-caption match information. One branch of previous methods established pseudo-label relationships between phrases and regions based on the Expectation-Maximization (EM) algorithm combined wi…

2024

Code-Style In-Context Learning for Knowledge-Based Question Answering

AAAI 2024technical

Current methods for Knowledge-Based Question Answering (KBQA) usually rely on complex training techniques and model frameworks, leading to many limitations in practical applications. Recently, the emergence of In-Context Learning (ICL) capabilities in Large Language Models (LLMs) provides a simple a…

2024

Cross-Modal and Uni-Modal Soft-Label Alignment for Image-Text Retrieval

AAAI 2024technical

Current image-text retrieval methods have demonstrated impressive performance in recent years. However, they still face two problems: the inter-modal matching missing problem and the intra-modal semantic loss problem. These problems can significantly affect the accuracy of image-text retrieval. To a…

2024

Narrowing the Gap between Supervised and Unsupervised Sentence Representation Learning with Large Language Model

AAAI 2024technical

Sentence Representation Learning (SRL) is a fundamental task in Natural Language Processing (NLP), with the Contrastive Learning of Sentence Embeddings (CSE) being the mainstream technique due to its superior performance. An intriguing phenomenon in CSE is the significant performance gap between sup…

2024

Towards Better Understanding of Contrastive Sentence Representation Learning: A Unified Paradigm for Gradient

ACL 2024long

Sentence Representation Learning (SRL) is a crucial task in Natural Language Processing (NLP), where contrastive Self-Supervised Learning (SSL) is currently a mainstream approach. However, the reasons behind its remarkable effectiveness remain unclear. Specifically, many studies have investigated th…

2023

On The Inadequacy of Optimizing Alignment and Uniformity in Contrastive Learning of Sentence Representations

ICLR 2023poster

Contrastive learning is widely used in areas such as visual representation learning (VRL) and sentence representation learning (SRL). Considering the differences between VRL and SRL in terms of negative sample size and evaluation focus, we believe that the solid findings obtained in VRL may not be e…

Cited by 9SourcePDFScholar