← Search

Kamil Adamczewski

13 accepted papers

2026

Attention Sinks as Internal Signals for Hallucination Detection in Large Language Models

ICML 2026poster

Large language models frequently exhibit hallucinations: fluent and confident outputs that are factually incorrect or unsupported by the input context. While recent hallucination detection methods have explored various features derived from attention maps, the underlying mechanisms they exploit rema…

Cited by 0SourceScholar
2026

Unifying Deep Stochastic Processes for Image Enhancement

ICML 2026poster

Deep stochastic processes have recently become a central paradigm for image enhancement, with many methods explicitly conditioning the stochastic trajectory on the degraded input. However, the relationship between these conditional processes and standard diffusion models remains unclear. In this wor…

Cited by 0SourceScholar
2025

How to Train Your Multi-Exit Model? Analyzing the Impact of Training Strategies

ICML 2025poster

Early exits enable the network's forward pass to terminate early by attaching trainable internal classifiers to the backbone network. Existing early-exit methods typically adopt either a joint training approach, where the backbone and exit heads are trained simultaneously, or a disjoint approach, wh…

Cited by 0SourcePDFScholar
2025

Joint MoE Scaling Laws: Mixture of Experts Can Be Memory Efficient

ICML 2025poster

Mixture of Experts (MoE) architectures have significantly increased computational efficiency in both research and real-world applications of large-scale machine learning models. However, their scalability and efficiency under memory constraints remain relatively underexplored. In this work, we prese…

Cited by 0SourcePDFScholar
2024

AdaGlimpse: Active Visual Exploration with Arbitrary Glimpse Position and Scale

ECCV 2024poster

"Active Visual Exploration (AVE) is a task that involves dynamically selecting observations (glimpses), which is critical to facilitate comprehension and navigation within an environment. While modern AVE methods have demonstrated impressive performance, they are constrained to fixed-scale glimpses…

2024

Scaling Laws for Fine-Grained Mixture of Experts

ICML 2024poster

Mixture of Experts (MoE) models have emerged as a primary solution for reducing the computational cost of Large Language Models. In this work, we analyze their scaling properties, highlighting certain arbitrary assumptions present in the existing literature. In particular, we introduce a new hyperpa…

2022

Hermite Polynomial Features for Private Data Generation

ICML 2022spotlight

Kernel mean embedding is a useful tool to compare probability measures. Despite its usefulness, kernel mean embedding considers infinite-dimensional features, which are challenging to handle in the context of differentially private data generation. A recent work, DP-MERF (Harder et al., 2021), propo…

2022

Lidar Line Selection with Spatially-Aware Shapley Value for Cost-Efficient Depth Completion

CoRL 2022poster

Lidar is a vital sensor for estimating the depth of a scene. Typical spinning lidars emit pulses arranged in several horizontal lines and the monetary cost of the sensor increases with the number of these lines. In this work, we present the new problem of optimizing the positioning of lidar lines to…

Cited by 2SourceScholar
2022

Revisiting Random Channel Pruning for Neural Network Compression

CVPR 2022poster

Channel (or 3D filter) pruning serves as an effective way to accelerate the inference of neural networks. There has been a flurry of algorithms that try to solve this practical problem, each being claimed effective in some ways. Yet, a benchmark to compare those algorithms directly is lacking, mainl…

Cited by 131PDFcodeScholar
2021

DP-MERF: Differentially Private Mean Embeddings with RandomFeatures for Practical Privacy-preserving Data Generation

AISTATS 2021poster

We propose a differentially private data generation paradigm using random feature representations of kernel mean embeddings when comparing the distribution of true data with that of synthetic data. We exploit the random feature representations for two important benefits. First, we require a minimal…

2015

Subgraph Matching Using Compactness Prior for Robust Feature Correspondence

CVPR 2015poster

Feature correspondence plays a central role in various computer vision applications. It is widely formulated as a graph matching problem due to its robust performance under challenging conditions, such as background clutter, object deformation and repetitive patterns. A variety of fast and accurate…

Cited by 30SourcePDFScholar