← Search

Bernhard Schoelkopf

12 accepted papers

2023

A Causal Framework to Quantify the Robustness of Mathematical Reasoning with Language Models

ACL 2023long

We have recently witnessed a number of impressive results on hard mathematical reasoning problems with language models. At the same time, the robustness of these models has also been called into question; recent works have shown that models can rely on shallow patterns in the problem description whe…

2023

Membership Inference Attacks against Language Models via Neighbourhood Comparison

ACL 2023findings

Membership Inference attacks (MIAs) aim to predict whether a data sample was present in the training data of a machine learning model or not, and are widely used for assessing the privacy risks of language models. Most existing attacks rely on the observation that models tend toassign higher probabi…

2022

Differentially Private Language Models for Secure Data Sharing

EMNLP 2022main

To protect the privacy of individuals whose data is being shared, it is of high importance to develop methods allowing researchers and companies to release textual data while providing formal privacy guarantees to its originators. In the field of NLP, substantial efforts have been directed at buildi…

2022

Logical Fallacy Detection

EMNLP 2022finding

Reasoning is central to human intelligence. However, fallacious arguments are common, and some exacerbate problems such as spreading misinformation about climate change. In this paper, we propose the task of logical fallacy detection, and provide a new dataset (Logic) of logical fallacies generally…

2021

Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP

EMNLP 2021main

The principle of independent causal mechanisms (ICM) states that generative processes of real world data consist of independent modules which do not influence or inform each other. While this idea has led to fruitful developments in the field of causal inference, it is not widely-known in the NLP co…

2021

Mining the Cause of Political Decision-Making from Social Media: A Case Study of COVID-19 Policies across the US States

EMNLP 2021finding

Mining the causes of political decision-making is an active research area in the field of political science. In the past, most studies have focused on long-term policies that are collected over several decades of time, and have primarily relied on surveys as the main source of predictors. However, t…

Cited by 16SourcePDFScholar
2018

Cause-Effect Inference by Comparing Regression Errors

AISTATS 2018poster

We address the problem of inferring the causal relation between two variables by comparing the least-squares errors of the predictions in both possible causal directions. Under the assumption of an independence between the function relating cause and effect, the conditional noise distribution, and t…

Cited by 0SourcePDFScholar
2017

Local Group Invariant Representations via Orbit Embeddings

AISTATS 2017poster

Invariance to nuisance transformations is one of the desirable properties of effective representations. We consider transformations that form a group and propose an approach based on kernel methods to derive local group invariant representations. Locality is achieved by defining a suitable probabili…

Cited by 40SourcePDFScholar
2015

Causal Inference by Identification of Vector Autoregressive Processes with Hidden Components

ICML 2015poster

A widely applied approach to causal inference from a time series X, often referred to as “(linear) Granger causal analysis”, is to simply regress present on past and interpret the regression matrix \hatB causally. However, if there is an unmeasured time series Z that influences X, then this approach…

Cited by 95SourcePDFScholar
2015

Discovering Temporal Causal Relations from Subsampled Data

ICML 2015poster

Granger causal analysis has been an important tool for causal analysis for time series in various fields, including neuroscience and economics, and recently it has been extended to include instantaneous effects between the time series to explain the contemporaneous dependence in the residuals. In th…

Cited by 110SourcePDFScholar
2015

Telling cause from effect in deterministic linear dynamical systems

ICML 2015poster

Telling a cause from its effect using observed time series data is a major challenge in natural and social sciences. Assuming the effect is generated by the cause through a linear system, we propose a new approach based on the hypothesis that nature chooses the “cause” and the “mechanism generating…

Cited by 67SourcePDFScholar