This work discusses the results of two user studies aiming to evaluate the NESPOLE! speech-to-speech translation system, which provides for multilingual and multimodal communication in the tourism and in the medical domain, allowing users to interact through the Internet by sharing maps, web-pages and pen-based gestures. The purpose is to investigate the overall effectiveness of the combination of multimodality and multilinguality in respect to a speech-only system. Specifically, we will examine the improvement in usability offered by the multimodal system, which is gauged by evaluating the interaction between novice users and the system at several stages of development. Additionally, we will discuss how data collection contributed to system improvement
Scheda prodotto non validato
Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte di FBK.
Titolo: | The NESPOLE! Multimodal Speech-to-Speech Translation System: User Based System Improvements |
Autori: | |
Data di pubblicazione: | 2003 |
Abstract: | This work discusses the results of two user studies aiming to evaluate the NESPOLE! speech-to-speech translation system, which provides for multilingual and multimodal communication in the tourism and in the medical domain, allowing users to interact through the Internet by sharing maps, web-pages and pen-based gestures. The purpose is to investigate the overall effectiveness of the combination of multimodality and multilinguality in respect to a speech-only system. Specifically, we will examine the improvement in usability offered by the multimodal system, which is gauged by evaluating the interaction between novice users and the system at several stages of development. Additionally, we will discuss how data collection contributed to system improvement |
Handle: | http://hdl.handle.net/11582/1648 |
Appare nelle tipologie: | 4.1 Contributo in Atti di convegno |