In computer science, a convolutional deep belief network (CDBN) is a type of deep artificial neural network composed of multiple layers of convolutional restricted Boltzmann machines stacked together.[1] Alternatively, it is a hierarchical generative model for deep learning, which is highly effective in image processing and object recognition, though it has been used in other domains too.[2] The salient features of the model include the fact that it scales well to high-dimensional images and is translation-invariant.[3]

CDBNs use the technique of probabilistic max-pooling to reduce the dimensions in higher layers in the network. Training of the network involves a pre-training stage accomplished in a greedy layer-wise manner, similar to other deep belief networks. Depending on whether the network is to be used for discrimination or generative tasks, it is then "fine tuned" or trained with either back-propagation or the up–down algorithm (contrastive–divergence), respectively.

References

  1. ↑ Lee, Honglak; Grosse, Ranganath; Andrew Ng. "Convolutional Deep Belief Networks for Scalable Unsupervised Learning of Hierarchical Representations" (PDF). {{cite journal}}: Cite journal requires |journal= (help)
  2. ↑ Lee, Honglak; Yan Largman; Peter Pham; Andrew Y. Ng. "Unsupervised feature learning for audio classification using convolutional deep belief networks" (PDF).
  3. ↑ Coviello, Emanuele. "Convolutional Deep Belief Networks" (PDF).
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.