← Search

James Holt

11 accepted papers

2024

A Walsh Hadamard Derived Linear Vector Symbolic Architecture

NeurIPS 2024poster

Vector Symbolic Architectures (VSAs) are one approach to developing Neuro-symbolic AI, where two vectors in $\mathbb{R}^d$ are 'bound' together to produce a new vector in the same space. VSAs support the commutativity and associativity of this binding operation, along with an inverse operation, allo…

2024

Assemblage: Automatic Binary Dataset Construction for Machine Learning

NeurIPS 2024poster

Binary code is pervasive, and binary analysis is a key task in reverse engineering, malware classification, and vulnerability discovery. Unfortunately, while there exist large corpuses of malicious binaries, obtaining high-quality corpuses of benign binaries for modern systems has proven challenging…

2024

Holographic Global Convolutional Networks for Long-Range Prediction Tasks in Malware Detection

AISTATS 2024poster

Malware detection is an interesting and valuable domain to work in because it has significant real-world impact and unique machine-learning challenges. We investigate existing long-range techniques and benchmarks and find that they’re not very suitable in this problem area. In this paper, we introdu…

2024

Is Function Similarity Over-Engineered? Building a Benchmark

NeurIPS 2024poster

Binary analysis is a core component of many critical security tasks, including reverse engineering, malware analysis, and vulnerability detection. Manual analysis is often time-consuming, but identifying commonly-used or previously-seen functions can reduce the time it takes to understand a new file…

2024

Stabilizing Linear Passive-Aggressive Online Learning with Weighted Reservoir Sampling

NeurIPS 2024poster

Online learning methods, like the seminal Passive-Aggressive (PA) classifier, are still highly effective for high-dimensional streaming data, out-of-core processing, and other throughput-sensitive applications. Many such algorithms rely on fast adaptation to individual errors as a key to their conve…

2023

Recasting Self-Attention with Holographic Reduced Representations

ICML 2023poster

In recent years, self-attention has become the dominant paradigm for sequence modeling in a variety of domains. However, in domains with very long sequence lengths the $\mathcal{O}(T^2)$ memory and $\mathcal{O}(T^2 H)$ compute costs can make using transformers infeasible. Motivated by problems in ma…

2022

Deploying Convolutional Networks on Untrusted Platforms Using 2D Holographic Reduced Representations

ICML 2022spotlight

Due to the computational cost of running inference for a neural network, the need to deploy the inferential steps on a third party’s compute environment or hardware is common. If the third party is not fully trusted, it is desirable to obfuscate the nature of the inputs and outputs, so that the thir…

2022

Out of Distribution Data Detection Using Dropout Bayesian Neural Networks

AAAI 2022technical

We explore the utility of information contained within a dropout based Bayesian neural network (BNN) for the task of detecting out of distribution (OOD) data. We first show how previous attempts to leverage the randomized embeddings induced by the intermediate layers of a dropout BNN can fail due to…

Cited by 35SourcePDFScholar
2021

Learning with Holographic Reduced Representations

NeurIPS 2021spotlight

Holographic Reduced Representations (HRR) are a method for performing symbolic AI on top of real-valued vectors by associating each vector with an abstract concept, and providing mathematical operations to manipulate vectors as if they were classic symbolic objects. This method has seen little use o…