Real-time Human Action Search using Random Forest based Hough Voting

Gang Yu, Junsong Yuan, and Zicheng Liu

Abstract

Many existing techniques in content based video retrieval treat a video sequence as a whole to match it against a query video or to assign a text label. Such an approach has serious limitations when applied to human action retrieval because an action may occur only in a sub-region and last for a small portion of the video length. In situations like this, we essen- tially need to match the subvolumes of the video sequences against the query video. A naive exhaustive search is im- practical due to large number of possible subvolumes for each video sequence. In this paper, we propose a novel framework for action retrieval which performs pattern matching at sub- volume level and is very efficient in handling large corpus of videos. We construct an unsupervised random forest to in- dex the video database, generate a score volume with Hough voting and then employ a max sub-path strategy to quickly search for the temporal and spatial positions of all the video sequences in the database. We present action search experi- ments on challenging datasets to validate the efficiency and effectiveness of our system.

Details

Publication typeProceedings
Published inMultimeda (ACMMM)
PublisherACM
> Publications > Real-time Human Action Search using Random Forest based Hough Voting