August 3 1999
Life
Highlights

Fringe benefits
A chilling friendship
Europeans go west
Samuel Brittan
Voices in the air
Philip Stephens
Salt in Tory wound
  Life / Technology
COMPUTING: Microsoft taps the market for voice-operated portables


Microsoft logoAdvertisements for hand-held computers and communications devices promise a world where information is at your fingertips anytime and anywhere. What they fail to tell you is that accessing information on a portable device can be a pain, with many products using tiny, cramped keyboards or fiddly electronic pens, writes George Cole. Now, Microsoft has developed a system it calls "Tap and Talk", which combines speech recognition technology with a small stylus or pen. The stylus is used to call up information by tapping an on-screen field or icon - there is no handwriting recognition software. Instead, the user speaks into the device to enter data or commands.

"We're approaching an era of ubiquitous computing, where computers will be on almost every device. Some of these will be too small for a keyboard," says Xuedong Huang, manager of the speech technology group at Microsoft Research.

The research group has developed the first prototype to use Tap and Talk technology, the MiPad (multimodal interactive pad), a palm-sized device that is a combined cellular phone, pager and hand-held computer. MiPad grew out of a project known as Dr Who (for work, home and office), which is developing a series of technologies for portable computing.

The MiPad has a built-in microphone, which is activated whenever a field is tapped. The speech recognition system, Whisper, has a 64,000-word dictionary, and recognises natural or continuous speech. Users "train" the MiPad to recognise their speech by speaking into the built-in microphone for 30 minutes - Dr Huang recommends reading a book.

The device also uses a spoken-language understanding engine, which understands context. For example, when the user calls up the contact list and says, "Meet Mark East on Friday at four", the Mipad understands that the user means this coming Friday at 4pm and not in the early morning.

Putting speech technology on a portable device is no gimmick, according to Dr Huang. "Using speech to enter data is twice as slow as using a full-size computer keyboard, but it is five times faster than using the miniature keyboards found on hand-held computers," he says.

MiPad has most of the features used by personal information management systems, including an address book, contact list, receiving e-mail and address book, but Microsoft has no firm date for when devices such as MiPad will reach the market. So it remains to be seen whether the term "tap and talk" will become as ubiquitous in the PC world as the phrase "cut and paste". http://research.microsoft.com/stg/xdh