← Search

Nikola Simidjievski

11 accepted papers

2026

INSTANT: Compressing Gradients and Activations for Resource-Efficient Training

ICLR 2026poster

Deep learning has advanced at an unprecedented pace. This progress has led to a significant increase in its complexity. However, despite extensive research on accelerating inference, training deep models directly within a resource-constrained budget remains a considerable challenge due to its high c…

Cited by 0SourcecodeScholar
2025

Measuring Cross-Modal Interactions in Multimodal Models

AAAI 2025technical

Integrating AI in healthcare can greatly improve patient care and system efficiency. However, the lack of explainability in AI systems (XAI) hinders their clinical adoption, especially in multimodal decision-making that combines various data sources. The majority of existing XAI methods focus on uni…

2025

Multimodal Lego: Model Merging and Fine-Tuning Across Topologies and Modalities in Biomedicine

ICLR 2025poster

Learning holistic computational representations in physical, chemical or biological systems requires the ability to process information from different distributions and modalities within the same model. Thus, the demand for multimodal machine learning models has sharply risen for modalities that go…

2024

HEALNet: Multimodal Fusion for Heterogeneous Biomedical Data

NeurIPS 2024poster

Technological advances in medical data collection, such as high-throughput genomic sequencing and digital high-resolution histopathology, have contributed to the rising requirement for multimodal biomedical modelling, specifically for image, tabular and graph data. Most multimodal deep learning appr…

2024

ProtoGate: Prototype-based Neural Networks with Global-to-local Feature Selection for Tabular Biomedical Data

ICML 2024poster

Tabular biomedical data poses challenges in machine learning because it is often high-dimensional and typically low-sample-size (HDLSS). Previous research has attempted to address these challenges via local feature selection, but existing approaches often fail to achieve optimal performance due to t…

2024

TabEBM: A Tabular Data Augmentation Method with Distinct Class-Specific Energy-Based Models

NeurIPS 2024poster

Data collection is often difficult in critical fields such as medicine, physics, and chemistry, yielding typically only small tabular datasets. However, classification methods tend to struggle with these small datasets, leading to poor predictive performance. Increasing the training set with additio…

2023

Weight Predictor Network with Feature Selection for Small Sample Tabular Biomedical Data

AAAI 2023technical

Tabular biomedical data is often high-dimensional but with a very small number of samples. Although recent work showed that well-regularised simple neural networks could outperform more sophisticated architectures on tabular data, they are still prone to overfitting on tiny datasets with many potent…

2022

Attentional Meta-learners for Few-shot Polythetic Classification

ICML 2022spotlight

Polythetic classifications, based on shared patterns of features that need neither be universal nor constant among members of a class, are common in the natural world and greatly outnumber monothetic classifications over a set of features. We show that threshold meta-learners, such as Prototypical N…

2020

Constraining Variational Inference with Geometric Jensen-Shannon Divergence

NeurIPS 2020poster

We examine the problem of controlling divergences for latent space regularisation in variational autoencoders. Specifically, when aiming to reconstruct example $x\in\mathbb{R}^{m}$ via latent space $z\in\mathbb{R}^{n}$ ($n\leq m$), while balancing this against the need for generalisable latent repre…

2020

On Second Order Behaviour in Augmented Neural ODEs

NeurIPS 2020poster

Neural Ordinary Differential Equations (NODEs) are a new class of models that transform data continuously through infinite-depth architectures. The continuous nature of NODEs has made them particularly suitable for learning the dynamics of complex physical systems. While previous work has mostly bee…

Cited by 116SourcePDFScholar