← Search

Denis Dimitrov

5 accepted papers

2025

RusCode: Russian Cultural Code Benchmark for Text-to-Image Generation

NAACL 2025findings

Text-to-image generation models have gained popularity among users around the world. However, many of these models exhibit a strong bias toward English-speaking cultures, ignoring or misrepresenting the unique characteristics of other language groups, countries, and nationalities. The lack of cultur…

2024

Kandinsky 3: Text-to-Image Synthesis for Multifunctional Generative Framework

EMNLP 2024system demonstrations

Text-to-image (T2I) diffusion models are popular for introducing image manipulation methods, such as editing, image fusion, inpainting, etc. At the same time, image-to-video (I2V) and text-to-video (T2V) models are also built on top of T2I models. We present Kandinsky 3, a novel T2I model based on l…

2024

MERA: A Comprehensive LLM Evaluation in Russian

ACL 2024long

Over the past few years, one of the most notable advancements in AI research has been in foundation models (FMs), headlined by the rise of language models (LMs). However, despite researchers’ attention and the rapid growth in LM application, the capabilities, limitations, and associated risks still…

2024

Your Transformer is Secretly Linear

ACL 2024long

This paper reveals a novel linear characteristic exclusive to transformer decoders, including models like GPT, LLaMA, OPT, BLOOM and others. We analyze embedding transformations between sequential layers, uncovering an almost perfect linear relationship (Procrustes similarity score of 0.99). However…

2022

Survey on Efficient Training of Large Neural Networks

IJCAI 2022poster

Modern Deep Neural Networks (DNNs) require significant memory to store weight, activations, and other intermediate tensors during training. Hence, many models don’t fit one GPU device or can be trained using only a small per-GPU batch size. This survey provides a systematic overview of the approache…