Low-Light Amodal Objects Tracking: A Benchmark

Abstract

Object tracking in real-world scenarios is often hampered by the simultaneous challenges of low light and partial object occlusion. While existing evaluation datasets have tackled these scenarios separately-focusing either on low-light settings or amodal perception-their co-occurrence has rarely been studied. To bridge this gap, we introduce LAOT (Low-Light Amodal Object Tracking), a benchmark tailored to assess how state-of-the-art tracking algorithms perform under the combined challenges of dim lighting and partial object occlusion. The dataset consists of 201 diverse video sequences with over 16K frames, each meticulously annotated with both modal bounding boxes (representing the visible part of the object) and amodal bounding boxes (estimating the complete object extent, including occluded regions). To characterize occlusion severity, object instances are categorized into three levels based on visible proportion: 0-20% (no occlusion), 20-80% (partial occlusion), and 80-100% (heavy occlusion). We benchmark 21 state-of-the-art tracking algorithms, including ARTrack [1], AVTrack [2], DropTrack [3], SeqTrack [4], ProContEXT [5], and HIPTrack [6], using Average Precision (AP) as the evaluation metric across occlusion levels. The results reveal a consistent decline in tracking accuracy as occlusion increases. For example, DropTrack achieves 0.8382 AP without occlusion but drops to 0.1730 AP with heavy occlusion; similarly, AVTrack falls from 0.7375 to 0.1276. These findings expose the limitations of current methods in coping with simultaneous challenges in low light and amodal perception. LAOT serves as a comprehensive and diagnostic benchmark to guide the development of robust perception-aware tracking algorithms suited for visually degraded environments.The LAOT is available at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/LSW-CVLab/LAOT</uri>