← Search

Shreya Shankar

3 accepted papers

2025

PROMPTEVALS: A Dataset of Assertions and Guardrails for Custom Production Large Language Model Pipelines

NAACL 2025long

Large language models (LLMs) are increasingly deployed in specialized production data processing pipelines across diverse domains—such as finance, marketing, and e-commerce. However, when running them in production across many inputs, they often fail to follow instructions or meet developer expectat…

2020

Enabling certification of verification-agnostic networks via memory-efficient semidefinite programming

NeurIPS 2020poster

Convex relaxations have emerged as a promising approach for verifying properties of neural networks, but widely used using Linear Programming (LP) relaxations only provide meaningful certificates when networks are specifically trained to facilitate verification. This precludes many important applica…

2018

Adversarial Examples that Fool both Computer Vision and Time-Limited Humans

NeurIPS 2018poster

Machine learning models are vulnerable to adversarial examples: small changes to images can cause computer vision models to make mistakes such as identifying a school bus as an ostrich. However, it is still an open question whether humans are prone to similar mistakes. Here, we address this question…

Cited by 327SourcePDFScholar