← Search

Stamatios Lefkimmiatis

11 accepted papers

2026

Share Your Attention: Transformer Weight Sharing via Matrix-based Dictionary Learning

AAAI 2026technical

Large language models (LLMs) have revolutionized AI applications, yet their high computational and memory demands hinder their widespread deployment. Existing compression techniques focus on intra-block optimizations (e.g., low-rank approximation or attention head pruning), while the repetitive laye

Cited by 0SourcePDFScholar
2025

ReplaceMe: Network Simplification via Depth Pruning and Transformer Block Linearization

NeurIPS 2025poster

We introduce ReplaceMe, a generalized training-free depth pruning method that effectively replaces transformer blocks with a linear operation, while maintaining high performance for low compression ratios. In contrast to conventional pruning approaches that require additional training or fine-tuning…

Cited by 0SourcecodeScholar
2024

A Modular Conditional Diffusion Framework for Image Reconstruction

NeurIPS 2024poster

Diffusion Probabilistic Models (DPMs) have been recently utilized to deal with various blind image restoration (IR) tasks, where they have demonstrated outstanding performance in terms of perceptual quality. However, the task-specific nature of existing solutions and the excessive computational cost…

Cited by 0SourcePDFScholar
2024

GSLoc: Visual Localization with 3D Gaussian Splatting

IROS 2024poster

We present GSLoc: a new visual localization method that performs dense camera alignment using 3D Gaussian Splatting as a map representation of the scene. GSLoc backpropagates pose gradients over the rendering pipeline to align the rendered and target images, while it adopts a coarse-to-fine strategy…

Cited by 5SourceScholar
2024

Robust Two-View Geometry Estimation with Implicit Differentiation

IROS 2024poster

We present a novel two-view geometry estimation framework which is based on a differentiable robust loss function fitting. We propose to treat the robust fundamental matrix estimation as an implicit layer, which allows us to avoid backpropagation through time and significantly improves the numerical…

Cited by 0SourcecodeScholar
2023

Integral Neural Networks

CVPR 2023poster

We introduce a new family of deep neural networks. Instead of the conventional representation of network layers as N-dimensional weight tensors, we use continuous layer representation along the filter and channel dimensions. We call such networks Integral Neural Networks (INNs). In particular, the w…

2023

Learning Sparse and Low-Rank Priors for Image Recovery via Iterative Reweighted Least Squares Minimization

ICLR 2023poster

In this work we introduce a novel optimization algorithm for image recovery under learned sparse and low-rank constraints, which are parameterized with weighted extensions of the $\ell_p^p$-vector and $\mathcal{S}_p^p$ Schatten-matrix quasi-norms for $0\!<p\!\le1$, respectively. Our proposed algorit…

Cited by 11SourcePDFScholar
2020

Microscopy Image Restoration with Deep Wiener-Kolmogorov Filters

ECCV 2020poster

Microscopy is a powerful visualization tool in biology, enabling the study of cells, tissues, and the fundamental biological processes; yet, the observed images typically suffer from blur and background noise. In this work, we propose a unifying framework of algorithms for Gaussian image deblurring…

2018

Deep Image Demosaicking using a Cascade of Convolutional Residual Denoising Networks

ECCV 2018poster

Demosaicking and denoising are among the most crucial steps of modern digital camera pipelines and their joint treatment is a highly ill-posed inverse problem where at-least two-thirds of the information are missing and the rest are corrupted by noise. This poses a great challenge in obtaining meani…

Cited by 149SourcePDFScholar