← Search

Shotaro Akaho

4 accepted papers

2024

Local Distance Correlation Embedding for Time-Series Analysis on Riemannian Manifolds

ICASSP 2024accepted

This paper proposes a time-series data embedding technique that preserves curvature and orientation, with a focus on visualizing temporal manifold-valued data. Manifold-valued data provide pair-wise local distances on which the proposed method is built. First, we introduce a simpler form of our meth…

Cited by 0SourceScholar
2022

Learning curves for continual learning in neural networks: Self-knowledge transfer and forgetting

ICLR 2022poster

Sequential training from task to task is becoming one of the major objects in deep learning applications such as continual learning and transfer learning. Nevertheless, it remains unclear under what conditions the trained model's performance improves or deteriorates. To deepen our understanding of s…

Cited by 23SourcePDFScholar
2019

The Normalization Method for Alleviating Pathological Sharpness in Wide Neural Networks

NeurIPS 2019poster

Normalization methods play an important role in enhancing the performance of deep learning while their theoretical understandings have been limited. To theoretically elucidate the effectiveness of normalization, we quantify the geometry of the parameter space determined by the Fisher information mat…

Cited by 52SourcePDFScholar
2019

Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approach

AISTATS 2019poster

The Fisher information matrix (FIM) is a fundamental quantity to represent the characteristics of a stochastic model, including deep neural networks (DNNs). The present study reveals novel statistics of FIM that are universal among a wide class of DNNs. To this end, we use random weights and large w…

Cited by 157SourcePDFScholar