← Search

Jacob Beck

7 accepted papers

2025

Metalic: Meta-Learning In-Context with Protein Language Models

ICLR 2025poster

Predicting the biophysical and functional properties of proteins is essential for in silico protein design. Machine learning has emerged as a promising technique for such prediction tasks. However, the relative scarcity of in vitro annotations means that these models often have little, or no, specif…

2024

Distilling Morphology-Conditioned Hypernetworks for Efficient Universal Morphology Control

ICML 2024poster

Learning a universal policy across different robot morphologies can significantly improve learning efficiency and enable zero-shot generalization to unseen morphologies. However, learning a highly performant universal policy requires sophisticated architectures like transformers (TF) that have large…

2023

Annotation Sensitivity: Training Data Collection Methods Affect Model Performance

EMNLP 2023long findings

When training data are collected from human annotators, the design of the annotation instrument, the instructions given to annotators, the characteristics of the annotators, and their interactions can impact training data. This study demonstrates that design choices made when creating an annotation…

Cited by 0SourcecodeScholar
2023

Recurrent Hypernetworks are Surprisingly Strong in Meta-RL

NeurIPS 2023poster

Deep reinforcement learning (RL) is notoriously impractical to deploy due to sample inefficiency. Meta-RL directly addresses this sample inefficiency by learning to perform few-shot learning when a distribution of related tasks is available for meta-training. While many specialized meta-RL methods h…

2020

AMRL: Aggregated Memory For Reinforcement Learning

ICLR 2020poster

In many partially observable scenarios, Reinforcement Learning (RL) agents must rely on long-term memory in order to learn an optimal policy. We demonstrate that using techniques from NLP and supervised learning fails at RL tasks due to stochasticity from the environment and from exploration. Utiliz…

Cited by 26SourceScholar