← Search

Gal Cohen

2 accepted papers

2025

INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge

ICLR 2025spotlight

The performance differential of large language models (LLM) between languages hinders their effective deployment in many regions, inhibiting the potential economic and societal value of generative AI tools in many communities. However, the development of functional LLMs in many languages (i.e., mult…

Cited by 9SourcePDFScholar
2025

Jamba: Hybrid Transformer-Mamba Language Models

ICLR 2025poster

We present Jamba, a novel hybrid Transformer-Mamba mixture-of-experts (MoE) architecture. Jamba interleaves blocks of Transformer and Mamba layers, enjoying the benefits of both model families. MoE is added in some of these layers to increase model capacity while keeping active parameter usage manag…

Cited by 3SourcePDFScholar