Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Learning in the Deep-Structured Conditional Random Fields

Dong Yu, Li Deng, and Shizhen Wang

Abstract

We have proposed the deep-structured conditional random fields (CRFs) for sequential labeling and classification recently. The core of this model is its deep structure and its discriminative nature. This paper outlines the learning strategies and algorithms we have developed for the deep-structured CRFs, with a focus on the new strategy that combines the layer-wise unsupervised pre-training using entropy-based multi-objective optimization and the conditional likelihood-based back-propagation fine tuning, as inspired by the recent development in learning deep belief networks.

Details

Publication typeProceedings
Published inNIPS 2009 Workshop on Deep Learning for Speech Recognition and Related Applications
> Publications > Learning in the Deep-Structured Conditional Random Fields