BiLian Ke

Object-Oriented Anchoring and Modal Alignment in Multimodal Learning

"Modality alignment has been of paramount importance in recent developments of multimodal learning, which has inspired many innovations in multimodal networks and pre-training tasks. Single-stream networks can effectively leverage self-attention mechanisms to facilitate modality interactions but suf…