← Search

Albert Xu

8 accepted papers

2024

Mathematical Justification of Hard Negative Mining via Isometric Approximation Theorem

ICLR 2024poster

In deep metric learning, the triplet loss has emerged as a popular method to learn many computer vision and natural language processing tasks such as facial recognition, object detection, and visual-semantic embeddings. One issue that plagues the triplet loss is network collapse, an undesirable phen…

Cited by 2SourcePDFScholar
2023

Contrastive Novelty-Augmented Learning: Anticipating Outliers with Large Language Models

ACL 2023long

In many task settings, text classification models are likely to encounter examples from novel classes on which they cannot predict correctly. Selective prediction, in which models abstain on low-confidence examples, provides a possible solution, but existing models are often overly confident on unse…

2023

Estimating Large Language Model Capabilities without Labeled Test Data

EMNLP 2023long findings

Large Language Models (LLMs) have exhibited an impressive ability to perform in-context learning (ICL) from only a few examples, but the success of ICL varies widely from task to task. Thus, it is important to quickly determine whether ICL is applicable to a new task, but directly evaluating ICL acc…

Cited by 0SourcecodeScholar
2023

Toward Closed-Loop Additive Manufacturing: Paradigm Shift in Fabrication, Inspection, and Repair

IROS 2023poster

Increased usage of additive manufacturing (AM) in various industries has solidified its role as an advanced manufacturing technique. However, there is an inherent lack of reliability in AM processes, particularly common in extrusion or deposition-based methods due to the stochastic nature of ma-teri…

Cited by 4SourceScholar
2022

Automated Crossword Solving

ACL 2022long

We present the Berkeley Crossword Solver, a state-of-the-art approach for automatically solving crossword puzzles. Our system works by generating answer candidates for each crossword clue using neural question answering models and then combines loopy belief propagation with local search to find full…

2021

Detoxifying Language Models Risks Marginalizing Minority Voices

NAACL 2021long

Language models (LMs) must be both safe and equitable to be responsibly deployed in practice. With safety in mind, numerous detoxification techniques (e.g., Dathathri et al. 2020; Krause et al. 2020) have been proposed to mitigate toxic LM generations. In this work, we show that these detoxification…

2021

Visual-Laser-Inertial SLAM Using a Compact 3D Scanner for Confined Space

ICRA 2021poster

Three-dimensional reconstruction in confined spaces is important for the manufacturing of aircraft wings, inspection of narrow pipes, examination of turbine blades, etc. It is also challenging because confined spaces tend to lack a positioning infrastructure, and conventional sensors often cannot de…

Cited by 8SourceScholar