NLify: Lightweight Spoken Natural Language Interfaces via Exhaustive Paraphrasing

Seungyeop Han, Matthai Philipose, and Yun-Cheng Ju

Abstract

This paper presents the design and implementation of a programming

system that enables third-party developers to add

spoken natural language (SNL) interfaces to standalone mobile

applications. The central challenge is to create statistical

recognition models that are accurate and resource-efficient

in the face of the variety of natural language, while requiring

little specialized knowledge from developers. We show

that given a few examples from the developer, it is possible

to elicit comprehensive sets of paraphrases of the examples

using internet crowds. The exhaustive nature of these paraphrases

allows us to use relatively simple, automatically derived

statistical models for speech and language understanding

that perform well without per-application tuning. We have

realized our design fully as an extension to the Visual Studio

IDE. Based on a new benchmark dataset with 3500 spoken

instances of 27 commands from 20 subjects and a small developer

study, we establish the promise of our approach and

the impact of various design choices.

Details

Publication typeInproceedings
Published inProceedings of UbiComp 2013
PublisherACM
> Publications > NLify: Lightweight Spoken Natural Language Interfaces via Exhaustive Paraphrasing