Muneki Yasuda

Relationship between PreTraining and Maximum Likelihood Estimation in Deep Boltzmann Machines

A pretraining algorithm, which is a layer-by-layer greedy learning algorithm, for a deep Boltzmann machine (DBM) is presented in this paper. By considering the deep belief net type of pretraining for the DBM, which is a simplified version of the original pretraining of the DBM, two interesting the…