Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
A Non-parametric Approach to Pair-wise Dynamic Topic Correlation Detection

Yang Song, Lu Zhang, and C. Lee Giles

Abstract

We introduce dynamic correlated topic models (DCTM) for analyzing discrete data over time. This model is inspired by the hierarchical Gaussian process latent variable models (GP-LVM). DCTM is essentially a on-linear dimension reduction technique which is capable of (1) detecting topic evolution within a document corpus, (2) discovering topic correlations between document corpora, (3) monitoring topic and correlation trends dynamically. Unlike generative aspect models such like LDA, DCTM demonstrates a much faster converging rate with better model fitting to the data. We empirically assess our approach using 268,231 scientific documents, from the year 1988 to 2005. Posterior inferences suggest that DCTM is useful for capturing topic and correlation dynamics, as well as predicting their trends.

Details

Publication typeInproceedings
Published inIEEE International Conference on Data Mining series (ICDM 2008)
PublisherIEEE
> Publications > A Non-parametric Approach to Pair-wise Dynamic Topic Correlation Detection