Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
Predicting Human Activities using Spatio-Temporal Structure of Interest Points

Gang Yu, Junsong Yuan, and Zicheng Liu

Abstract

Early recognition and prediction of human activities are of great importance in video surveillance, e.g., by recognizing a criminal activity at its beginning stage, it is possible to avoid unfortunate outcomes. We address early activity recogni- tion by developing a Spatial-Temporal Implicit Shape Mod- el (STISM), which characterizes the space-time structure of the sparse local features extracted from a video. The ear- ly recognition of human activities is accomplished by pat- tern matching through STISM. To enable efficient and ro- bust matching, we propose a new random forest structure, called multi-class balanced random forest, which makes a good trade-off between the balance of the trees and the dis- criminative abilities. The prediction is done simultaneously for multiple classes, which saves both the memory and com- putational cost. The experiments show that our algorithm significantly outperforms the state of the arts for the human activity prediction problem.

Details

Publication typeProceedings
Published inMultimedia (ACMMM)
PublisherACM
> Publications > Predicting Human Activities using Spatio-Temporal Structure of Interest Points