← Search

Konstantin Hemker

3 accepted papers

2025

Measuring Cross-Modal Interactions in Multimodal Models

AAAI 2025technical

Integrating AI in healthcare can greatly improve patient care and system efficiency. However, the lack of explainability in AI systems (XAI) hinders their clinical adoption, especially in multimodal decision-making that combines various data sources. The majority of existing XAI methods focus on uni…

2025

Multimodal Lego: Model Merging and Fine-Tuning Across Topologies and Modalities in Biomedicine

ICLR 2025poster

Learning holistic computational representations in physical, chemical or biological systems requires the ability to process information from different distributions and modalities within the same model. Thus, the demand for multimodal machine learning models has sharply risen for modalities that go…

2024

HEALNet: Multimodal Fusion for Heterogeneous Biomedical Data

NeurIPS 2024poster

Technological advances in medical data collection, such as high-throughput genomic sequencing and digital high-resolution histopathology, have contributed to the rising requirement for multimodal biomedical modelling, specifically for image, tabular and graph data. Most multimodal deep learning appr…