4 accepted papers
Multi-token prediction (MTP) architecture is widely adopted in LLMs. MTP blocks can be appended to the tail of model to predict additional tokens. However, when training with pipeline parallel, MTP leads to more pipeline bubbles and deteriorates the pipeline efficiency. Based on in-depth analysis of…
Discovering atom-level phenomena requires molecular dynamics (MD) simulations with ab initio accuracy. Machine learning interatomic potentials (MLIPs) enable stable, high-accuracy MD simulations, and their models exhibit scaling-law trends similar to large language models. However, the lack of scala…
In this paper, we investigate the anomaly detection problem for multi-pixel targets in hyperspectral imagery when training data are available. We derive the generalized likelihood ratio test and obtain its analytical expressions of the probability of false alarm and probability of detection. The per…
The problem of detecting a subspace signal is studied in colored Gaussian noise with an unknown covariance matrix. In the subspace model, the target signal belongs to a known subspace, but with unknown coordinates. We propose a modified Rao test (MRT) by introducing a tunable parameter. The MRT is m…