Integrating Visual, Audio And Text Analysis For News Video
- Wei Qi ,
- Lie Gu ,
- Hao Jiang ,
- Hong-Jiang Zhang ,
- Xiang-Rong Chen
Published by Institute of Electrical and Electronics Engineers, Inc.
In this paper, we present a system developed for content-based broadcasted news video browsing for home users. There are three main factors that distinguish our work from other similar ones. First, we have integrated the image and audio analysis results in identifying news segments. Second, we use the video OCR technology to detect text from frames, which provides a good source of textual information for story classification when transcripts and close captions are not available. Finally, natural language processing (NLP) technologies are used to perform automated categorization of news stories based on the texts obtained from close caption or video OCR process. Based on these video structure and contentanalysis technologies, we have developed two advanced video browsers for home users: intelligent highlight player and HTML-based video browser.
© 2000 IEEE. Personal use of this material is permitted. However, permission to reprint/republish this material for advertising or promotional purposes or for creating new collective works for resale or redistribution to servers or lists, or to reuse any copyrighted component of this work in other works must be obtained from the IEEE.