Share on Facebook Tweet on Twitter Share on LinkedIn Share by email
An automatic captioning system for telemedicine

Yunxin Zhao, X. Zhang, Rusheng Hu, Jian Xue, Xiaolong Li, Lili Che, Rong Hu, and Laura Schopp


In this paper, we present a first exposition of an automatic closed captioning system designed to assist hearing impaired users in telemedicine. This system automatically separates telehealth conversation speech between a health care provider and a client into two streams and provides real-time captions of health care provider’s speech to client. The captioning system is based on the state-of-the-art technology of large vocabulary conversational speech recognition, encompassing speech stream separation, acoustic modeling, language modeling, real-time decoding, confidence annotation, and human-computer interface, with innovations made in several components. The system currently handles a vocabulary size over 46 K. Real-time captioning performance at the average word accuracy of 77.95% is reported.


Publication typeInproceedings
Published inProceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP'2006)
AddressToulouse, France
PublisherInstitute of Electrical and Electronics Engineers, Inc.
> Publications > An automatic captioning system for telemedicine