Research Interests
-
Dialog management: Applications of machine learning; integration of expert knowledge; multi-modal dialog management; planning techniques; on-line improvement
-
Dialog and user modeling: Tracking and quantifying uncertainty in dialog state for human/computer dialog; representational structures for dialog state; ontology integration; simulation
-
Turn-taking: Use of continuous/incremental speech recognition for turn-taking; integration of conversation history and user model for turn-taking
-
Confidence scoring: Machine-learning-based approaches to confidence scoring; calibration in confidence scoring; features for confidence scoring
-
Planning under uncertainty: Markov decision processes (MDPs); partially observable Markov decision processes (POMDPs); reinforcement learning.
Experience
- Microsoft Research, Researcher, 2012-Present
- AT&T Labs Research, Principal Member of Technical Staff, 2006-2012
- Cambridge University, Ph D, Engineering Dept, 2002-2006
- Edify Corp, Senior consultant - Usability and Speech Technology, 2002-2005
- Tellme Networks, Voice Application Development Manager, 2000-2001
- McKinsey & Company, Associate, 1999-2000
- Cambridge University, Masters, Speech/Language Processing, 1998-1999
- Princeton University, BSE, Electrical Engineering, 1994-1998
Dialog State Tracking Challenge
The Dialog State Tracking Challenge (DSTC) is a research community challenge task for accurately estimating a user's goal in a spoken dialog system. DSTC homepage.
- Jason D. Williams, Spoken dialog systems as an application of planning under uncertainty, in Invited talk at International Conference on Automated Planning and Scheduling (ICAPS), Freiburg, Germany, 2011
- Jason D. Williams, Speech technologies for interactive mobile applications – a primer, in Invited talk at Joint workshop of the Association for Voice Interaction Design (AVIxD) and the Interaction Design Association (IxDA), New York City, USA, 2011
- Jason D. Williams, Steve Young, and Blaise Thomson, Statistical approaches to dialogue systems (tutorial, including videos), 2009
- Jason D. Williams, Blaise Thomson, and Steve Young, Bibliography for Statistical Approaches to Spoken Dialogue Systems , August 2009
- Jason D. Williams, Spoken dialogue systems: challenges, and opportunities for research (invited talk), in Proc IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Merano, Italy, 2009
2013
- Angeliki Metallinou, Dan Bohus, and Jason D. Williams, Discriminative state tracking for spoken dialog systems, in Proceedings of Annual Meeting of the Association for Computational Linguistics (ACL), Sofia, Bulgaria, Association for Computational Linguistics, August 2013
- Li Deng, Jinyu Li, Jui-Ting Huang, Kaisheng Yao, Dong Yu, Frank Seide, Michael Seltzer, Geoff Zweig, Xiaodong He, Jason Williams, Yifan Gong, and Alex Acero, Recent Advances in Deep Learning for Speech Research at Microsoft, IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), May 2013
- Steve Young, Milica Gasic, Blaise Thomson, and Jason Williams, POMDP-based Statistical Spoken Dialogue Systems: a Review, in Proceedings of the IEEE, vol. PP, no. 99, pp. 1-20, Proceedings of the IEEE, 2013
2012
- Jason D. Williams, A critical analysis of two statistical spoken dialog systems in public use, in Proceedings IEEE Workshop on Spoken Language Technology (SLT), IEEE Spoken Language Technology Workshop, 3 December 2012
- Ethan O. Selfridge, Peter A. Heeman, Iker Arizmendi, and Jason D. Williams, Demonstrating the incremental interaction manager in an end-to-end "Lets Go!" dialogue system, in Demonstration at IEEE Workshop on Spoken Language Technology (SLT), IEEE Workshop on Spoken Language Technologies, 2 December 2012
- Jason D. Williams, Challenges and Opportunities for State Tracking in Statistical Spoken Dialog Systems: Results From Two Public Deployments, in IEEE Journal of Selected Topics in Signal Processing, vol. 6, no. 8, pp. 959-970, IEEE SPS, December 2012
- Ethan O. Selfridge, Iker Arizmendi, Peter A. Heeman, and Jason D. Williams, Integrating Incremental Speech Recognition and POMDP-based Dialogue, in Proceedings of 13th annual SIGdial Meeting on Discourse and Dialogue, July 2012
- Jason D. Williams, A belief tracking challenge task for spoken dialog systems, in NAACL HLT 2012 Workshop on Future directions and needs in the Spoken Dialog Community: Tools and Data, Association for Computational Linguistics, June 2012
- Junlan Feng, Bhuvana Ramabhadran, John H. L. Hansen, and Jason D. Williams, Trends in Speech and Language Processing, in IEEE Signal Processing Magazine, pp. 177-179, Human Computer Interaction International Conference, 2012
2011
- Alan W Black, Susanne Burger, Alistair Conkie, Helen Hastie, Simon Keizer, Oliver Lemon, Nicolas Merigaud, Gabriel Parent, Gabriel Schubiner, Blaise Thomson, Jason D. Williams, Kai Yu, Steve Young, and Maxine Eskenazi, Spoken Dialog Challenge 2010: Comparison of Live and Control Test Results, in Proc SIGDIAL, Portland, Oregon, USA, 2011
- Jason D. Williams, Speech technologies for interactive mobile applications – a primer, in Invited talk at Joint workshop of the Association for Voice Interaction Design (AVIxD) and the Interaction Design Association (IxDA), New York City, USA, 2011
- Jason D. Williams, Spoken dialog systems as an application of planning under uncertainty, in Invited talk at International Conference on Automated Planning and Scheduling (ICAPS), Freiburg, Germany, 2011
- Ethan Selfridge, Iker Arizmendi, Peter Heeman, and Jason D. Williams, Stability and Accuracy in Incremental Speech Recognition, in Proc SIGDIAL, Portland, Oregon, USA, 2011
- Jason D. Williams, An Empirical Evaluation of a Statistical Dialog System in Public Use, in Proc SIGDIAL, Portland, Oregon, USA, 2011
- Jason D. Williams, I. Dan Melamed, Tirso Alonso, Barbara Hollister, and Jay Wilpon, Crowd-sourcing for difficult transcription of speech, in IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Hawaii, USA, 2011
- Jason D. Williams, Decision Theory Models for Applications in Artificial Intelligence: Concepts and Solutions, IGI Global, 2011
2010
- Jason D. Williams, Spoken dialog systems as an application of POMDPs (invited talk), in Proc ICAPS workshop on POMDP Practitioners Workshop: solving real-world POMDP problems, Toronto, Canada, 2010
- Jason D. Williams, Incremental partition recombination for efficient tracking of multiple dialog states, in Proc ICASSP, Dallas, Texas, USA, 2010
- Jason D. Williams, Iker Arizmendi, and Alistair Conkie, Demonstration of AT&T "Let's Go": A production-grade statistical spoken dialog system, in Proc Demonstration Session at IEEE Workshop on Spoken Language Technology (SLT), Berkeley, California, USA, 2010
2009
- Lihong Li, Jason D. Williams, and Suhrid Balakrishnan, Reinforcement Learning for Dialog Management using Least-Squares Policy Iteration and Fast Feature Selection, in Proc Interspeech, Brighton, United Kingdom, 2009
- Lihong Li, Jason D. Williams, and Suhrid Balakrishnan, Reinforcement Learning for Spoken Dialog Management using Least-Squares Policy Iteration and Fast Feature Selection, in Proceedings of the Tenth Annual Conference of the International Speech Communication Association (INTERSPEECH-09), 2009
- Jason D. Williams, Spoken dialogue systems: challenges, and opportunities for research (invited talk), in Proc IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Merano, Italy, 2009
- Jason D. Williams and Suhrid Balakrishnan, Estimating probability of correctness for ASR N-Best lists, in Proc SIGDIAL, London, United Kingdom, 2009
2008
- Jason D. Williams, Demonstration of a POMDP Voice Dialer, in Proc Demonstration Session, Annual Meeting of the Association for Computational Linguistics (ACL) with Human Language Technology Conference (HLT), Columbus, Ohio, USA, 2008
- Umar Syed and Jason D. Williams, Using Automatically Transcribed Dialogs to Learn User Models in a Spoken Dialog System, in Proc Annual Meeting of the Association for Computational Linguistics (ACL) with Human Language Technology Conference (HLT), Columbus, Ohio, USA, 2008
- Jason D. Williams, The best of both worlds: Unifying conventional dialog systems and POMDPs, in Proc Interspeech, Brisbane, Australia, 2008
- Jason D. Williams, Integrating expert knowledge into POMDP optimization for spoken dialog systems, in Proc AAAI Workshop on Advancements in POMDP Solvers, Chicago, USA, 2008
- Jason D. Williams, Exploiting the ASR N-Best by tracking multiple dialog state hypotheses, in Proc Interspeech, Brisbane, Australia, 2008
- Jason D. Williams, Evaluating user simulations with the Cramer-von Mises divergence, in Speech Communication, vol. 50, no. 10, pp. 829-846, 2008
- Jason D. Williams, Pascal Poupart, and Steve Young, Partially Observable Markov Decision Processes with Continuous Observations for Dialogue Management (invited chapter), in Recent Trends in Discourse and Dialogue, Springer, 2008
2007
- Jason D. Williams and Steve Young, Scaling POMDPs for spoken dialog management, in IEEE Trans. on Audio, Speech, and Language Processing, vol. 15, no. 7, pp. 2116-2129, 2007
- Jason D. Williams, Using Particle Filters to Track Dialogue State, in Proc IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Kyoto, Japan, 2007
- Jason D. Williams, A Method for Evaluating and Comparing User Simulations: The Cramer-von Mises Divergence, in Proc IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Kyoto, Japan, 2007
- Jason D. Williams, Applying POMDPs to Dialog Systems in the Troubleshooting Domain, in Proc HLT/NAACL Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technology, Rochester, NY, USA, 2007
- Jason D. Williams and Steve Young, Partially Observable Markov Decision Processes for Spoken Dialog Systems, in Computer Speech and Language, vol. 21, no. 2, pp. 393-422, 2007
2006
- Jason D. Williams and Steve Young, Scaling POMDPs for dialog management with composite summary point-based value iteration (CSPBVI), in Proc AAAI Workshop on statistical and empirical methods in spoken dialog systems, Boston, USA, 2006
2005
- Jason D. Williams, Pascal Poupart, and Steve Young, Factored Partially Observable Markov Decision Processes for Dialogue Management, in Proc Workshop on Knowledge and Reasoning in Practical Dialog Systems, International Joint Conference on Artificial Intelligence (IJCAI), Edinburgh, 2005
- Jason D. Williams, Pascal Poupart, and Steve Young, Partially Observable Markov Decision Processes with Continuous Observations for Dialogue Management, in Proc SIGDIAL Workshop on Discourse and Dialogue, Lisbon, 2005
- Jason D. Williams and Steve Young, Scaling Up POMDPs for Dialog Management: The "Summary POMDP" Method, in Proc IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), San Juan, Puerto Rico, USA, 2005
2004
- Jason D. Williams, Lawrence Piano, Lizanne Kaiser, and Andrew T. Shaw, VUI Design Heuristics for Call Routing: Insights from Usability Testing (invited chapter), in VUI Visions: Expert views on Effective Voice User Interface Design, TMA Associates, 2004
- Jason D. Williams and Silke M. Witt, A Comparison of Dialog Strategies for Call Routing (invited article), in International Journal of Speech Technology, vol. 7, no. 1, pp. 9-24, 2004
- Matthew Stuttle, Jason D. Williams, and Steve Young, A Framework for Wizard-of-Oz Experiments with a Simulated ASR-Channel, in Proc Intl Conf on Speech and Language Processing (ICSLP), Jeju, South Korea, 2004
- Jason D. Williams and Steve Young, Characterizing Task-Oriented Dialog using a Simulated ASR Channel, in Proc Intl Conf on Speech and Language Processing (ICSLP), Jeju, South Korea, 2004
2003
- Jason D. Williams and Steve Young, Using Wizard-of-Oz simulations to bootstrap Reinforcement-Learning-based dialog management systems, in Proc SIGDIAL Workshop on Discourse and Dialogue, Sapporo, Japan, 2003
- Jason D. Williams, Andrew T. Shaw, Lawrence Piano, and Michael Abt, Preference, Perception, and Task Completion of Open, Menu-based, and Directed Prompts for Call Routing: a Case Study, in Proc Eurospeech, Geneva, Switzerland, 2003
- Silke M. Witt and Jason D. Williams, Two Studies of Open vs. Directed Dialog Strategies in Spoken Dialog Systems, in Proc Eurospeech, Geneva, Switzerland, 2003
- Jason D. Williams, Andrew T. Shaw, Lawrence Piano, and Michael Abt, Evaluating real callers' reactions to Open and Directed Strategy prompts, in Proc Applied Voice Input/Output Society Speech Developers Conference, San Jose, California, 2003
- Jason D. Williams, Partially Observable Markov Decision Processes for Spoken Dialogue Management, Cambridge University Engineering Department, 2006
AT&T Statistical Dialog Toolkit (ASDT): Softare for tracking a distribution over a large number of hidden states in a spoken dialog systems. Available under license agreement from AT&T Labs Research.
- SigDial Best student paper award: 2011
- ISCA award for best paper in Computer Speech and Language, for the period 2005-2009: 2010
- AT&T Key Contributor award: 2010, 2009
- AT&T Intellectual Property achievement award: 2010
- AT&T Labs President Excellence Award: 2010
- AT&T Labs Research excellence award: 2007
- AVIOS Best paper award: 2003
Angeliki Metallinou, Summer 2012.
Belief tracking in dialog systems.
Currently a PhD student with Shrikanth Narayanan, University of Southern California.
Ethan Selfridge, Summer 2010 and 2011 at AT&T.
Turn-taking in dialog systems.
Currently a PhD student with Peter Heeman, Oregon Health & Science University.
Hamid Chinaei, Summer 2010 at AT&T.
Reinforcement learning for dialog systems.
Currently a PhD student with Brahim Chaib-draa, Laval University.
John Asmuth, Summer 2009 at AT&T.
Bayesian approaches to reinforcement learning.
Currently a PhD student with Michael Littman, Rutgers University.
Lihong Li, Summer 2008 at AT&T.
Feature selection in reinforcement learning.
Currently a Researcher with Microsoft Research.
Umar Syed, Summer 2007 at AT&T.
Learning user models from unlabeled data.
Currently a research scientist at Google.
Ethan Selfridge, Oregon Health & Science University (in progress)
Rohit Kumar, Carnegie Melon University (2011).
8010364: System and method for applying probability distribution models to dialog systems in the troubleshooting domain
[ + 10 more patent application filed with the US Patent Office ]
- SIGDIAL - Special Interest Group on Discourse and Dialogue, Vice-President, 2013-2015.
- IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Technical Chair (Dialog area), 2013.
- SIGDIAL Conference 2013, Program committee Co-chair.
- Real Dialog Data Challenge, Advisory board, 2013.
- Dialog Research Center, Carnegie Mellon University, Industrial Advisory board, 2013.
- IEEE Journal of Selected Topics in Signal Processing: Special Issue on Advances in Spoken Dialogue Systems and Mobile Interface (vol 6, issue 8), Co-lead guest editor, 2012.
- IEEE Workshop on Spoken Language Technologies (SLT), Organizing committee, co-finance chair, 2012.
- SIGDIAL Conference, Organizing committee, sponsorship chair, 2012.
- AVIxD / IxDA Workshop: Designing for multi-modal interaction, Co-chair, organizing committee, 2012.
- SIGDIAL Conference, Organizing committee, sponsorship chair, 2011.
- Association for Voice Interaction Design (AVIxD), Board of directors, Treasurer, 2010-2012.
- IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), Organizing committee, publicity chair, 2011.
- SIGDIAL Conference, mentoring program coordinator, 2010.
- ICAPS Workshop: POMDP Practitioners Workshop: solving real-world POMDP problems, Organizing committee, 2010.
- Spoken Dialogue Challenge, Organizing Committee: 2010-2012.
- IEEE Speech and Language Technical Committee (SLTC), Elected member, 2009-2011.
- IEEE SLTC Newsletter, Editor-in-chief, 2009-2011.
- SIGDIAL - Special Interest Group on Discourse and Dialogue, Science Advisory Committee, 2007-2012.
- AAAI Workshop on statistical and empirical methods in spoken dialogue systems, organizer, 2006.
- NAACL-HLT Demonstration program co-chair, 2007.
- Young researchers' roundtable on spoken dialogue systems, organizer, 2005.
- IEEE Transactions on Audio, Speech, and Language Processing reviewer: 2012, 2011, 2010, 2008, 2007.
- Computer Speech and Language reviewer: 2012, 2011, 2010, 2009, 2008.
- Computational Linguistics reviewer: 2009.
- Speech Communication reviewer: 2011, 2010, 2008.
- Journal of Natural Language Engineering reviewer: 2008.
- ACM Transactions on Speech and Language Processing: 2010, 2011, 2012
- Pattern Recognition Letters reviewer: 2010.
- IEEE Signal Processing Magazine reviewer: 2007.
- Transactions on Systems, Man, and Cybernetics - Part B: Cybernetics reviewer: 2012.
- Service on 4 grant review panels, for US and international funding agencies.
- IUI reviewer: 2013.
- CHI reviewer: 2013.
- INTERSPEECH Scientific Review Committee: 2013, 2012, 2011.
- SIGDIAL program committee: 2013, 2012, 2011, 2010, 2009, 2008, 2007.
- ASRU Workshop program committee: 2011, 2009, 2007.
- EACL scientific review committee: 2012, 2009.
- ACL program committee: 2013, 2012, 2011.
- ACL demo committee: 2011.
- NAACL reviewer: 2012, 2009, 2007.
- IJCAI program committee: 2011, 2009, 2007.
- EMNLP program committee: 2009, 2008, 2006
- NIPS reviewer: 2010.
- ICASSP reviewer: 2013, 2012, 2011, 2010, 2009, 2008, 2007.
- SLAM: Joint ISCA/IEEE International Workshop on Speech, Language and Audio in Multimedia: 2013.
- ECAI/IJCAI Workshop on Machine Learning for Interactive Systems (MLIS): 2013, 2012
- IJCAI Workshop on Knowledge and Reasoning in Practical Dialogue Systems program committee: 2013, 2011, 2009.
- IEEE Workshop on Spoken Language Technology (SLTC) technical program committee: 2012, 2010, 2008.
- COLING Workshop: Spoken language technologies for pervasive speech-based and multimodal applications program committee: 2008
- Young researchers' roundtable on spoken dialogue systems advisory board: 2013, 2012, 2011, 2010, 2009, 2006.
- Workshop on Future directions and needs in the Spoken Dialog Community: Tools and Data scientific committee: 2012.
- ECAI Workshop on Machine Learning for Interactive Systems: 2012
Contact
jason.williams@microsoft.com
Tel: +1.425.703.7561
Fax: +1.425.936.7329
On fax, include: ATTN: JAWILLIA
Jason Williams
ATTN: JAWILLIA
Microsoft Corporation
One Microsoft Way
Redmond, WA 98052-6399
USA
