This paper reports on experiments performed in the develop- ment of the QALL-ME system, a multilingual QA infrastructure capable of handling input requests both in written and spoken form. Our objec- tive is to estimate the impact of dealing with automatically transcribed (i.e. noisy) requests on a specific question interpretation task, namely extraction of relations from natural language questions. A number of experiments are presented, featuring different combinations of manu-ally and automatically transcribed questions datasets to train and eval-uate the system. Results (ranging from 0.624 to 0.634 F-measure in the recogniton of the relations expressed by a question) demonstrate that the impact of noisy data on question interpretation is negligible with all the combinations of training/test data. This shows that the benefits of enabling speech access capabilities, allowing for a more natural human- machine interaction, outweight the minimal loss in terms of performance.

Dealing with Spoken Requests in a Multilingual Question Answering System

Gretter, Roberto;Kouylekov, Milen Ognianov;Negri, Matteo
2008

Abstract

This paper reports on experiments performed in the develop- ment of the QALL-ME system, a multilingual QA infrastructure capable of handling input requests both in written and spoken form. Our objec- tive is to estimate the impact of dealing with automatically transcribed (i.e. noisy) requests on a specific question interpretation task, namely extraction of relations from natural language questions. A number of experiments are presented, featuring different combinations of manu-ally and automatically transcribed questions datasets to train and eval-uate the system. Results (ranging from 0.624 to 0.634 F-measure in the recogniton of the relations expressed by a question) demonstrate that the impact of noisy data on question interpretation is negligible with all the combinations of training/test data. This shows that the benefits of enabling speech access capabilities, allowing for a more natural human- machine interaction, outweight the minimal loss in terms of performance.
9783540857754
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11582/4062
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact