← Search

Kaiwen Tang

2 accepted papers

2025

Sorbet: A Neuromorphic Hardware-Compatible Transformer-Based Spiking Language Model

ICML 2025poster

For reasons such as privacy, there are use cases for language models at the edge. This has given rise to small language models targeted for deployment in resource-constrained devices where energy efficiency is critical. Spiking neural networks (SNNs) offer a promising solution due to their energy ef…

2023

BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Models

ACL 2023findings

It is crucial to automatically construct knowledge graphs (KGs) of diverse new relations to support knowledge discovery and broad applications. Previous KG construction methods, based on either crowdsourcing or text mining, are often limited to a small predefined set of relations due to manual cost…