While the increase of electronic devices brings greater flexibility and control to our everyday environments, task-specific configuration of the myriad of devices becomes increasingly burdensome to the user. Ideally, interfaces for collections of such devices in our everyday environment should be calm, easy to learn and use, support control of favorite task specific configurations and allow the use of familiar names for configurations without learning. We propose a user-extensible natural language spoken interface for environment and device control. In order to support user customization in a natural language interface, the system must simultaneously learn the configurations and names for those configurations. We call this the simultaneous naming and configuration (SNAC) problem.
In this thesis, we identify and describe an approach to the simultaneous naming and configuration problem, and present a specific realization of our approach to the SNAC problem called Illuminac. We find that this kind of user-extensible speech interface is quite effective for some types of users and thus an important component in a complete solution to device configuration. In particular, we observe that users are willing to train the system, able to remember their commands, and willing to use voice commands in many cases.
User-Extensible Natural Language Spoken Interfaces for Environment and Device Control
Researchers may make free and open use of the UC Berkeley Library’s digitized public domain materials. However, some materials in our online collections may be protected by U.S. copyright law (Title 17, U.S.C.). Use or reproduction of materials protected by copyright beyond that allowed by fair use (Title 17, U.S.C. § 107) requires permission from the copyright owners. The use or reproduction of some materials may also be restricted by terms of University of California gift or purchase agreements, privacy and publicity rights, or trademark law. Responsibility for determining rights status and permissibility of any use or reproduction rests exclusively with the researcher. To learn more or make inquiries, please see our permissions policies (https://www.lib.berkeley.edu/about/permissions-policies).