Share this page
Share this page E-mail this page Print this page RSS feeds
Home > People > Dong Yu
Dong Yu

RESEARCHER
.

Brief Biography

Dr. Dong Yu (俞栋) joined Microsoft in 1998 and Microsoft Speech Research Group in 2002, where he is a researcher. He holds a Ph.D. degree in computer science from University of Idaho, an MS degree in computer science from Indiana University at Bloomington, an MS degree in electrical engineering from Chinese Academy of Sciences, and a BS degree (with honor) in electrical engineering from Zhejiang University (China). His current research interests include speech processing, robust speech recognition, discriminative training, spoken dialog system, voice search technology, machine learning, and pattern recognition. He is a senior member of IEEE, a member of ACM, and a member of ISCA.

Workshop Organization

Equation Number in Office 2007

Office 2007 comes with a very nice equation editor and bibliography manager. However, it does not support equation and theorem number management. To work around this problem. I have developed a set of macros. You can download it here.

In addition, you may find the IEEE bibliography style file for Office 2007 useful if you publish a lot with IEEE.

Publications

Book Chapters

  1. Dong Yu, Li Deng, "Speech-Centric Multimodal User Interface Design in Mobile Technology", Handbook of Research on User Interface Design and Evaluation for Mobile Technology (Editor: Joanna Lumsden), Jan. 2008, IGI.

Refereed Journals and Magazines

  1. Dong Yu, Li Deng, Alex Acero, "Using Continuous Features in the Maximum Entropy Model", Pattern Recognition Letters. doi: 10.1016/j.patrec.2009.06.005. Vol. 30, Issue 8, June, 2009.
  2. Dong Yu, Li Deng, Yifan Gong, Alex Acero, "A Novel Framework and Training Algorithm for Variable-Parameter Hidden Markov Models", IEEE Transactions on Audio, Speech and Language Processing, vol 17, no. 7, pp. 1348-1360, September 2009. 
  3. Dong Yu, Balakrishnan Varadarajan,Li Deng, Alex Acero, "Active Learning and Semi-supervised Learning for Speech Recognition: A Unified Framework using the Global Entropy Reduction Maximization Criterion", Computer Speech and Language - Special Issue on Emergent Artificial Intelligence Approaches for Pattern Recognition in Speech and Language Processing. doi:10.1016/j.csl.2009.03.004. online version published in March 2009.
  4. Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero, "A Unified Framework of HMM Adaptation with Joint Compensation of Additive and Convolutive Distortions", Computer Speech and Language, vol. 23, pp. 389-405, 2009. doi:10.1016/j.csl.2009.02.001.
  5. Sibel Yaman, Li Deng, Dong Yu, Ye-Yi Wang, Alex Acero, "An integrative and discriminative technique for spoken utterance classification", IEEE Transactions on Audio, Speech and Language Processing, vol. 6, no. 6, Aug. 2008, pages 1207-1215. doi: 10.1109/TASL.2008.2001106.
  6. Dong Yu, Li Deng, Xiaodong He, Alex Acero, "Large-Margin Minimum Classification Error Training: A Theoretical Risk Minimization Perspective", Computer Speech and Language, Vol. 22, No. 4, October 2008, pp. 415-429. doi:10.1016/j.csl.2008.03.002.
  7. Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero, "Robust Speech Recognition Using a Cepstral Minimum-Mean-Square-Error-Motivated Noise Suppressor", IEEE Transactions on Audio, Speech and Language Processing, vol. 16, no. 5, pp. 1061-1070, July 2008. DOI: 10.1109/TASL.2008.921761.
  8. Ye-Yi Wang, Dong Yu, Yun-Cheng Ju, Alex Acero, "An Introduction to Voice Search", IEEE Signal Processing Magazine (Special Issue on Spoken Language Technology), vol. 25, no. 3, pp. 28-38, May 2008. doi: 10.1109/MSP.2008.918411.
  9. Dong Yu, Deborah Frincke, "Improving the Quality of Alerts and Predicting Intruder¡¯s Next Goal with Hidden Colored Petri-Net", Computer Networks, Volume 51, Issue 3, 21 February 2007, Pages 632-654. doi: 10.1016/j.comnet.2006.05.008.
  10. Dong Yu, Li Deng, Alex Acero, "Speaker-Adaptive Learning of Resonance Targets in a Hidden Trajectory Model of Speech Coarticulation", Computer Speech and Language, Vol. 27, 2007, pp. 72-87. doi:10.1016/j.csl.2005.12.002.
  11. Dong Yu, Li Deng, Alex Acero, "A Lattice Search Technique for a Long-Contextual-Span Hidden Trajectory Model of Speech", Speech Communication, Elsevier. Volume: 48 Issue: 9, Sep 2006. pp. 1214-1226. doi:10.1016/j.specom.2006.05.002.
  12. Li Deng, Dong Yu, and Alex Acero. "Structured Speech Modeling", IEEE Trans. on Audio, Speech and Language Processing. Volume: 14 Issue: 5, Sep 2006. pp. 1492- 1504. doi: 10.1109/TASL.2006.878265.
  13. Li Deng, Dong Yu, and Alex Acero, "A Bidirectional Target-Filtering Model of Speech Coarticulation and Reduction: Two-Stage Implementation for Phonetic Recognition", IEEE Trans. Audio, Speech & Language Proc, vol. 14, No. 1, pp 256-265, Jan 2006. doi: 10.1109/TSA.2005.854107.
  14. Dong Yu, Alex Acero, "Semiautomatic Improvements of System-Initiative Spoken Dialog Applications Using Interactive Clustering", © IEEE Trans. Speech & Audio Proc (Special Issue on Data Mining of Speech, Audio and Dialog), Sept. 2005, vol.13, no. 5pp 661-671. DOI: 10.1109/TSA.2005.851876.
  15. Li Deng, Dong Yu, "A Speech-Centric Perspective for Human-Computer Interface: A Case Study", Journal of VLSI Signal Processing Systems (Special Issue on Multimedia Signal Processing), Vol. 41, No. 3. pp. 255-269, November 2005. doi: 10.1007/s11265-005-4150-4.

Invited/Other Journals and Magazines

  1. Dong Yu, Li Deng, "Solving Nonlinear Estimation Problems Using Splines",IEEE Signal Processing Magazine, vol. 26, no. 4, pp.86-90, July, 2009.
  2. Dong Yu, Li Deng, "Teach-Ware: Signal Processing Resources at Connexions",IEEE Signal Processing Magazine, March, 2009. doi: 10.1109/MSP.2008.931093.

Refereed Conferences

  1. Dong Yu, Li Deng, Alex Acero, "Hidden Conditional Random Field with Distribution Constraints for Phone Classification", Interspeech, pp. 676-679, 2009.
  2. Oriol Vinyals, Li Deng, Alex Acero, Dong Yu, "Discriminative Pronunciation Learning Using Phonetic Decoder and Minimum-Classification-Error Criterion", ICASSP 2009, Taipei, Taiwan.
  3. Hui Lin, Li Deng, Dong Yu, Yifan Gong, Alex Acero, Chin-Hui Lee, "A Study on Multilingual Acoustic Modeling For Large Vocabulary ASR", ICASSP 2009, Taipei, Taiwan.
  4. Dong Yu, Li Deng, Peng Liu, Jian Wu, Yifan Gong, Alex Acero, "Cross-Lingual Speech Recognition under Runtime Resource Constraints", ICASSP 2009, Taipei, Taiwan.
  5. Balakrishnan Varadarajan, Dong Yu, Li Deng, Alex Acero, "Maximizing Global Entropy Reduction for Active Learning In Speech Recognition", ICASSP 2009, Taipei, Taiwan.
  6. Balakrishnan Varadarajan, Dong Yu, Li Deng, Alex Acero, "Using Collective Information in Semi-Supervised Learning for Speech Recognition", ICASSP 2009, Taipei, Taiwan.
  7. Dong Yu, Li Deng, Jian Wu, Yifan Gong, Alex Acero, "Improvements on Mel-Frequency Cepstrum Minimum-Mean-Square-Error Noise Suppressor for Robust Speech Recognition", ISCSLP 2008, Kunmin, China.
  8. Hui Lin, Li Deng, Jasha Droppo, Dong Yu, Alex Acero, "Learning Methods in Multilingual Speech Recognition", NIPS 2008 workshops, whistler, BC, Canada, 2008.
  9. Dong Yu, Li Deng, Alex Acero, "The Maximum Entropy Model with Continuous Features", NIPS 2008 workshops, whistler, BC, Canada, 2008.
  10. Dong Yu, Li Deng, Yifan Gong, Alex Acero, "Discriminative Training of Variable-Parameter HMMs for Noise Robust Speech Recognition", Interspeech 2008, Brisbane, Australia.
  11. Dong Yu, Li Deng, Yifan Gong, Alex Acero, "Parameter Clustering and Sharing in Variable-Parameter HMMs for Noise Robust Speech Recognition", Interspeech 2008, Brisbane, Australia.
  12. Jinyu Li, Li Deng, Dong Yu, Jian Wu, Yifan Gong, Alex Acero, "Adaptation of Compressed HMM Parameters for Resource-Constrained Speech Recognition", ICASSP 2008, Las Vegas, USA.
  13. Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero, "HMM Adaptation Using a Phase-Sensitive Acoustic Distortion Model For Environment-Robust Speech Recognition", ICASSP 2008, Las Vegas, USA.
  14. Dong Yu, Li Deng, Jasha Droppo, Jian Wu, Yifan Gong, Alex Acero, "a Minimum-Mean-Square-Error Noise Reduction Algorithm on Mel-Frequency Cepstra for Robust Speech Recognition", ICASSP 2008, Las Vegas, USA.
  15. Jinyu Li, Li Deng, Dong Yu, Yifan Gong, Alex Acero, "High-Performance HMM Adaptation With Joint Compensation of Additive and Convolutive Distortions Via Vector Taylor Series", ASRU 2007, Kyoto, Japan.
  16. Ivan Tashev, Michael Seltzer, Yun-Cheng Ju, Dong Yu and Alex Acero, "Commute UX: Telephone Dialog System for Location-based Services", SIGDIAL 2007, Antwerp, Belgium.
  18. Geoffrey Zweig, Patrick Nguyen, Yun-Cheng Ju, Ye-Yi Wang, Dong Yu, Alex Acero, "The Voice-Rate Dialog System for Consumer Ratings", Interspeech 2007, Antwerp, Belgium.
  19. Dong Yu, Li Deng, Alex Acero, "Handling Phonetic Context and Speaker Variation in a Structure-Based Speech Recognizer", Interspeech 2007, Antwerp, Belgium.
  20. J. Sherwani, Dong Yu, Tim Paek, Mary Czerwinski, Yun-Cheng Ju, Alex Acero, "VoicePedia: Towards Speech-based Access to Unstructured Information", Interspeech 2007, Antwerp, Belgium.
  21. Dong Yu, Yun-Cheng Ju, Ye-Yi Wang, Geoffrey Zweig, Alex Acero, "Automated Directory Assistance System - from Theory to Practice", Interspeech 2007, Antwerp, Belgium.
  22. Ye-Yi Wang, Dong Yu, Yun-Cheng Ju, Geoffrey Zweig, Alex Acero, "Confidence Measures for Voice Search Applications", Interspeech 2007, Antwerp, Belgium.
  23. Dong Yu, Li Deng, Xiaodong He, Alex Acero, "Large-Margin Minimum Classification Error Training for Large-Scale Speech Recognition Tasks", ICASSP 2007, Hawaii, USA.
  26. Dong Yu, Li Deng, Xiaodong He, Alex Acero, "Use of Incrementally Regulated Discriminative Margins in MCE Training for Speech Recognition", in Proc. of the Interspeech Conference. Pittsburgh, Sep, 2006.
  27. Xiaolong Li, Li Deng, Dong Yu, Alex Acero, "A Time-Synchronous Phonetic Decoder for a Long-Contextual-Span Hidden Trajactory Model", Proc. of the Interspeech Conference. Pittsburgh, Sep, 2006.
  28. Dong Yu, Yun Cheng Ju, Alex Acero, "An Effective and Efficient Utterance Verification Technology Using Word N-gram Filler Models", in Proc. of the Interspeech Conference. Pittsburgh, Sep, 2006.
  29. Dong Yu, Yun Cheng Ju, Ye-Yi Wang, Alex Acero, "N-Gram Based Filler Model for Robust Grammar Authoring",in Proc. ICASSP 2006, Toulouse, France, May 2006.
  30. Li Deng, Dong Yu, and Alex Acero. "A Generative Modeling Framework for Structured Hidden Speech Dynamics", in Proc. NIPS Workshop on Advances in Structured Learning for Text and Speech Processing 2005.
  33. Dong Yu, Li Deng, and Alex Acero."Evaluation of a Long-contextual-span Hidden Trajectory Model and Phonetic Recognizer Using A* Lattice Search," in Proc of Interspeech, Lisbon, Sept 2005.
  34. Dong Yu, Deborah Frincke, "Alert Confidence Fusion in Intrusion Detection Systems with Extended Dempster-Shafer Theory" © ACM, in the 43rd Annual ACM Southeast Conference, Kennesaw, Georgia, March 18, 19 & 20, 2005.
  35. Dong Yu, Milind Mahajan, Peter Mau, and Alex Acero, "Maximum Entropy Based Generic Filter for Language Model Adaptation", in ICASSP 05, March 19-23, 2005, Philadelphia, PA, USA
  36. Li Deng, Xiang Li, Dong Yu, and Alex Acero, "A Hidden Trajectory Model with Bi-directional Target-Filtering: Cascaded vs. Integrated Implementation for Phonetic Recognition", in ICASSP 05, March 19-23, 2005, Philadelphia, PA, USA
  37. Dong Yu, Mei-Yuh Hwang , Peter Mau, Alex Acero, Li Deng, "Unsupervised Learning from Users' Error Correction in Speech Dictation", in Proceedings of InterSpeech-ICSLP 2004, October 4-8, 2004, Jeju, Korea.
  38. Li Deng, Dong Yu, and Alex Acero, "A Quantitative Model for Formant Dynamics and Contextually Assimilated Reduction in Fluent Speech", in Proceedings of InterSpeech-ICSLP 2004.
  39. Dong Yu, Deborah Frincke, "A Novel Framework for Alert Correlation and Understanding" (© Springer-Verlag), Springer's LNCS series, vol 3089. International Conference on Applied Cryptography and Network Security (ACNS) 2004.
  40. Dong Yu, Deborah Frincke, "Towards Survivable Intrusion Detection System", the 37th Hawaii International Conference On System Science (HICSS-37), Big Island, Hawaii, 2004.
  41. Dong Yu, Kuansan Wang, Milind Mahajan, Peter Mau, Alex Acero, "Improved Name Recognition With User Modeling", in Proceedings of EUROSPEECH 03, Geneva, Switzerland, 2003.
  42. Lei Yao, Dong Yu, and Taiyi Huang, "A unified spectral transformation adaptation approach for robust speech recognition", in Proceedings of the fourth International Conference in Spoken Language Proceedings (ICSLP-96), Philadelphia, PA, USA, 1996.
  43. Dong Yu and Taiyi Huang, "Canonical Correlation Based Compensation Approach for Robust Speech Recognition in Noisy Environment", in Proceedings of EUROSPEECH 95, pp477-480, Madrid, Spain, 1995.
  44. Dong Yu and Taiyi Huang, "A New HMM/NN Hybrid Method for High Performance Speech Recognition", in Proceedings of International Conference in Spoken Language Processing (ICSLP-94), Yokohama, Japan, 1994.
  45. Dong Yu and Taiyi Huang, "A New Time-alignment Approach for Robust Neural Network Based Speech Recognition", in Proceedings of IEEE International Conference in Signal Processing (ICSP-93), Beijiang, China, 1993.

Other Conferences and/or Short Papers:

  1. Geoffrey Zweig, Y.C. Ju, Patrick Nguyen, Dong Yu, Ye-Yi Wang, Alex Acero, "Voice-Rate: A Dialog System for Consumer Ratings", NAACL-HLT 2007, Rochester, New York, USA, pp31-32.
  2. Li Deng, Xiang Li, Dong Yu, and Alex Acero, "Novel Acoustic Modeling with Structured Hidden Dynamics for Speech Coarticulation and Reduction", in Proc. of the DARPA RT04 Workshop. Palisades, New York, Nov 2004.

Patents (US and/or International)

  1. "MaxEnt model with continuous features", with Li Deng and Alex Acero (pending, filed 2009)
  2. "Noise Suppressor for Robust Speech Recognition", with Li Deng, Yifan Gong, Jian Wu and Alex Acero (pending, filed 2008)
  3. "Adapting a Compressed Model for Use in Speech Recognition", with Jingyu Li, Li Deng, Yifan Gong, and Alex Acero (pending, filed 2008)
  4. "Phase Sensitive Model Adaptation for Noisy Speech Recognition", with Jingyu Li, Li Deng, Yifan Gong, and Alex Acero (pending, filed 2008)
  5. "Parameter Clustering and Sharing for Variable-Parameter Hidden Markov Models", with Li Deng, Yifan Gong, and Alex Acero (pending, filed 2008)
  6. "Piecewise-Based Variable-Parameter Hidden Markov Models and the Training Thereof", with Li Deng, Yifan Gong, and Alex Acero (pending, filed 2008)
  7. "Speech Recognition With Non-linear Noise Reduction on Mel-Frequency Cepstra", with Li Deng, Jasha Droppo, and Alex Acero (pending, filed 2008)
  8. "High Performance HMM Adaptation With Joint Compensation of Additive and Convolutive Distortions", with Jinyu Li, Li Deng, Alex Acero (pending, filed 2007)
  9. "Confidence Measure Generation for Speech Related Searching", with Ye-yi Wang and Yun-cheng Ju (pending, filed 2007)
  10. "Searching Database of Listing", with Ye-Yi Wang, Yun-Cheng Ju, Alex Acero and Geoffrey Zweig (pending, filed 2007)
  11. "Speech-Centric Multimodal User Interface Design in Mobile Technology", with Li Deng (pending, filed 2007)
  12. "A Generic Framework for Large-Margin MCE Training in Speech Recognition", with Li Deng, Xiaodong He, Alex Acero (pending, filed 2007)
  13. "Integrated Speech Recognition and Semantic Classification", with Sibel Yaman, Li Deng, Ye-Yi Wang, and Alex Acero (pending, filed 2007)
  14. "Hidden Trajectory Modeling with Differential Cepstra for Speech Recognition", with Li Deng (pending, filed 2007)
  15. "Adapting a Language Model to Accommodate Inputs Not Found in a Directory Assistance Listing", with Yun Cheng Ju and Alex Acero (pending, filed 2007)
  16. "Compound Word Splitting for Directory Assistance Services", with Yun Cheng Ju and Alex Acero (pending, filed 2007)
  17. "Incrementally Regulated Discriminative Margins in MCE Training for Speech Recognition", with Li Deng, Xiaodong He, Alex Acero (pending, filed 2006)
  18. "Detecting an Answering Machine Using Speech Recognition", with Yun Cheng Ju, Alex Acero, Craig M. Fisher, and Ye-yi Wang (pending, filed 2006)
  19. "Sharable Filler Model for Grammar Authoring", with Yun Cheng Ju, Alex Acero, and Ye-Yi Wang (pending, filed 2006)
  20. "Time Synchronous Decoding for Long-Span Hidden Trajectory Model", with Xiaolong Li, Li Deng, and Alex Acero (pending, filed 2006)
  21. "Parameter Learning in a Hidden Trajectory Model", with Li Deng, Xiaolong Li, Alex Acero (pending, filed 2006)
  22. "Time Asynchronous Decoding for Long-Span Trajectory Model", with Li Deng, Alex Acero (pending, filed 2005)
  23. "Learning Statistically Characterized Resonance Targets in a Hidden Trajectory Model", with Li Deng, Alex Acero (pending, filed 2005)
  24. "Configurable Grammar Templates", with Ye-Yi Wang, Yun-Cheng Ju, and Alex Acero (pending, filed 2005)
  25. "Interactive Clustering Method for Identifying Problems in Speech Applications", with Alex Acero (pending, filed 2005)
  26. "Classification Filter for Processing Data for Creating a Language Model", with Alex Acero, Julian J. Odell, Milind V. Mahajan, and Peter Mau (pending, filed 2005)
  27. "Method of Automatically Ranking Speech Dialog States and Transitions to Aid in Performance Analysis in Speech Applications", with Alex Acero (pending, filed 2005)
  28. "System and Method for Identifying Semantic Intent from Acoustic Information", with Xiao Li, Asela J. Gunawardana, Alex Acero, and Milind Mahajan (pending, filed 2005)
  29. "Automatic Speech Recognition Learning Using User Corrections", With Peter Mau, Mei-Yuh Hwang , and Alex Acero (pending, filed 2004)
  30. "Efficient Capitalization through User Modeling", with Peter Mau (pending, filed 2003)
  31. "Quantitative Model for Formant Dynamics and Contextually Assimilated Reduction in Fluent Speech", with Li Deng, and Alex Acero (granted 2009, US patent #7565292)
  32. "Indexing and Ranking Processes for Directory Assistance Services", with Yun Cheng Ju, Ye-yi Wang, and Alex Acero (granted 2009, US patent #7580942)
  33. "Acoustic Models with Structured Hidden Dynamics with Integration over Many Possible Hidden Trajectories", with Li Deng, and Alex Acero (granted 2009, US patent #7565284)
  34. "Speaker-adaptive Learning of Resonance Targets in a Hidden Trajectory Model of Speech Coarticulation", with Li Deng, Alex Acero (granted 2009, US patent #7519531)
  35. "Two Stage Implementation for Phonetic Recognition Using a Bi-directional Target-filtering Model of Speech Co-articulation and Reduction", with Li Deng, and Alex Acero (granted 2008, US patent #7409346)
  36. "System and method for user modeling to enhance named entity recognition ", with Peter Mau, Kuansan Wang, Milind Mahajan, and Alex Acero (granted 2007, US patent #7289956)

Technical Services

  • Grant reviewer: Research Grants Council (RGC) of Hong Kong
  • Associate editor: IEEE signal processing magazine (2008-now)
  • Technical program committee member: ICSC 2007, ICSC 2008, ISCSLP 2008, ASRU 2009
  • Organization committee member: MMSP 2006, ICSC 2008, NIPS workshop 2009.
  • Session chair: ACNS 2004, ICSC 2007.
  • Referee: IEEE Transactions on Audio, Speech, and Language Processing, J. Computer Speech and Language, J. Speech Communication, J. Pattern Recognition Letters, EURASIP J. on Audio Speech and Music Processing, J. Computer Security, J. Computer Networks, IEEE Transactions on Computer, J. Data & Knowledge Engineering, ICASSP 2004-now, INTERSPEECH 2004-now, NAACL-HLT 2009, ICSC 2007, EUSIPCO 2008, ACMSE 2005 , ASRU 2009-now.

Honors and Awards

  • Best Paper Award of ACMSE, 2005
  • Gold Star Award from Microsoft, 2004, 2009
  • Patent Awards from Microsoft, 2002-2009
  • Graduate school fellowship from Indiana University, 1995-96
  • Presidential Award of Chinese Academy of Sciences, 1994
  • Excellent Graduate Student Award from Chinese Academy of Sciences, 1993
  • Excellent Graduate Student Award from Graduate School, Academia Sinica, 1992
  • Excellent Graduate Award from Zhejiang province, 1991
  • Excellent Graduate Award from Zhejiang University, 1991
  • Excellent Student Award from Zhejiang University, 1987-1991

Site Map