END-TO-END SPEECH RECOGNITION ACCURACY METRIC FOR VOICE-SEARCH TASKS
- Michael Levit ,
- Nick Kibre ,
- Shawn Chang
ICASSP |
Published by IEEE - Institute of Electrical and Electronics Engineers
We introduce a novel metric for speech recognition success in voice search tasks, designed to reflect the impact of speec h recognition errors on user’s overall experience with the sy stem. The computation of the metric is seeded using intuitive labels from human subjects and subsequently automated by replacing human annotations with a machine learning algorithm. The results show that search-based recognition accuracy is significantly higher than accuracy based on sentence error rate computation, and that the automated system is very successful in replicating human judgments regarding search quality results.
© IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.