← Search

Michał Tyrolski

2 accepted papers

2023

Fast and Precise: Adjusting Planning Horizon with Adaptive Subgoal Search

ICLR 2023top-5%

Complex reasoning problems contain states that vary in the computational cost required to determine the right action plan. To take advantage of this property, we propose Adaptive Subgoal Search (AdaSubS), a search method that adaptively adjusts the planning horizon. To this end, AdaSubS generates di…

2022

Hierarchical Transformers Are More Efficient Language Models

NAACL 2022findings

Transformer models yield impressive results on many NLP and sequence modeling tasks. Remarkably, Transformers can handle long sequences, which allows them to produce long coherent outputs: entire paragraphs produced by GPT-3 or well-structured images produced by DALL-E. These large language models a…