Robust Domain Adaptation: Representations, Weights and Inductive Bias (Extended Abstract)

Victor Bouvier; Philippe Very; Clément Chastagnol; Myriam Tami; Céline Hudelot

IJCAI 2021poster0 citations

Robust Domain Adaptation: Representations, Weights and Inductive Bias (Extended Abstract)

Victor Bouvier, Philippe Very, Clément Chastagnol, Myriam Tami, Céline Hudelot

Abstract

Domain Invariant Representations (IR) has improved drastically the transferability of representations from a labelled source domain to a new and unlabelled target domain. Unsupervised Domain Adaptation (UDA) in presence of label shift remains an open problem. To this purpose, we present a bound of the target risk which incorporates both weights and invariant representations. Our theoretical analysis highlights the role of inductive bias in aligning distributions across domains. We illustrate it on standard benchmarks by proposing a new learning procedure for UDA. We observed empirically that weak inductive bias makes adaptation robust to label shift. The elaboration of stronger inductive bias is a promising direction for new UDA algorithms.

Machine Learning: Transfer, Adaptation, Multi-task LearningMachine Learning: Learning Theory

BibTeX

@inproceedings{ijcai2021p644,
  title     = {Robust Domain Adaptation: Representations, Weights and Inductive Bias (Extended Abstract)},
  author    = {Bouvier, Victor and Very, Philippe and Chastagnol, Clément and Tami, Myriam and Hudelot, Céline},
  booktitle = {Proceedings of the Thirtieth International Joint Conference on
               Artificial Intelligence, {IJCAI-21}},
  publisher = {International Joint Conferences on Artificial Intelligence Organization},
  editor    = {Zhi-Hua Zhou},
  pages     = {4750--4754},
  year      = {2021},
  month     = {8},
  note      = {Sister Conferences Best Papers},
  doi       = {10.24963/ijcai.2021/644},
  url       = {https://doi.org/10.24963/ijcai.2021/644},
}