← Search

Pavel Serdyukov

5 accepted papers

2019

Learning to select for a predefined ranking

ICML 2019oral

In this paper, we formulate a novel problem of learning to select a set of items maximizing the quality of their ordered list, where the order is predefined by some explicit rule. Unlike the classic information retrieval problem, in our setting, the predefined order of items in the list may not corr…

2019

Sequence Modeling with Unconstrained Generation Order

NeurIPS 2019poster

The dominant approach to sequence generation is to produce a sequence in some predefined order, e.g. left to right. In contrast, we propose a more general model that can generate the output sequence by inserting tokens in any arbitrary order. Our model learns decoding order as a result of its traini…

2018

Finding Influential Training Samples for Gradient Boosted Decision Trees

ICML 2018oral

We address the problem of finding influential training samples for a particular case of tree ensemble-based models, e.g., Random Forest (RF) or Gradient Boosted Decision Trees (GBDT). A natural way of formalizing this problem is studying how the model’s predictions change upon leave-one-out retraini…

2016

Efficient High-Order Interaction-Aware Feature Selection Based on Conditional Mutual Information

NeurIPS 2016poster

This study introduces a novel feature selection approach CMICOT, which is a further evolution of filter methods with sequential forward selection (SFS) whose scoring functions are based on conditional mutual information (MI). We state and study a novel saddle point (max-min) optimization problem to…

2016

Meta–Gradient Boosted Decision Tree Model for Weight and Target Learning

ICML 2016poster

Labeled training data is an essential part of any supervised machine learning framework. In practice, there is a trade-off between the quality of a label and its cost. In this paper, we consider a problem of learning to rank on a large-scale dataset with low-quality relevance labels aiming at maximi…