Park Jae Hyun

Layer-Wise Modality Decomposition for Interpretable Multimodal Sensor Fusion

In autonomous driving, transparency in the decision-making of perception models is critical, as even a single misperception can be catastrophic. Yet with multi-sensor inputs, it is difficult to determine how each modality contributes to a prediction because sensor information becomes entangled withi…