← Search

Nicholas A. Roy

4 accepted papers

2020

Belief-Dependent Macro-Action Discovery in POMDPs using the Value of Information

NeurIPS 2020poster

This work introduces macro-action discovery using value-of-information (VoI) for robust and efficient planning in partially observable Markov decision processes (POMDPs). POMDPs are a powerful framework for planning under uncertainty. Previous approaches have used high-level macro-actions within POM…

Cited by 13SourcePDFScholar
2020

Inferring learning rules from animal decision-making

NeurIPS 2020poster

How do animals learn? This remains an elusive question in neuroscience. Whereas reinforcement learning often focuses on the design of algorithms that enable artificial agents to efficiently learn new tasks, here we develop a modeling framework to directly infer the empirical learning rules that anim…

2018

Efficient inference for time-varying behavior during learning

NeurIPS 2018poster

The process of learning new behaviors over time is a problem of great interest in both neuroscience and artificial intelligence. However, most standard analyses of animal training data either treat behavior as fixed or track only coarse performance statistics (e.g., accuracy, bias), providing limite…

Cited by 31SourcePDFScholar
2017

Gaussian process based nonlinear latent structure discovery in multivariate spike train data

NeurIPS 2017poster

A large body of recent work focuses on methods for extracting low-dimensional latent structure from multi-neuron spike train data. Most such methods employ either linear latent dynamics or linear mappings from latent space to log spike rates. Here we propose a doubly nonlinear latent variable model…

Cited by 141SourcePDFScholar