This paper overviews FBK’s participation in the Textual En- tailment task at EVALITA 2009. Our runs were obtained through different configurations of EDITS (Edit Distance Textual Entailment Suite), the first freely available open source tool for Recognizing Textual Entailment (RTE). With a 71% Accuracy, EDITS reported the best score out of the 8 submitted runs. We describe the sources of knowledge that have been used (e.g. extraction of rules from Wikipedia), the different algorithms applied (i.e. Token Edit Distance, Tree Edit Distance), and the Particle Swarm Optimization (PSO) module used to estimate the optimal cost of edit operations in the cost scheme. Two different dependency parsers for the annotation of the data in the preprocessing phase have been compared, to assess the impact of the parser on EDITS performances. Finally, the obtained results and error analysis are discussed.

Recognizing Textual Entailment for Italian: EDITS @ EVALITA 2009

Cabrio, Elena;Mehdad, Yashar;Negri, Matteo;Kouylekov, Milen Ognianov;Magnini, Bernardo
2009-01-01

Abstract

This paper overviews FBK’s participation in the Textual En- tailment task at EVALITA 2009. Our runs were obtained through different configurations of EDITS (Edit Distance Textual Entailment Suite), the first freely available open source tool for Recognizing Textual Entailment (RTE). With a 71% Accuracy, EDITS reported the best score out of the 8 submitted runs. We describe the sources of knowledge that have been used (e.g. extraction of rules from Wikipedia), the different algorithms applied (i.e. Token Edit Distance, Tree Edit Distance), and the Particle Swarm Optimization (PSO) module used to estimate the optimal cost of edit operations in the cost scheme. Two different dependency parsers for the annotation of the data in the preprocessing phase have been compared, to assess the impact of the parser on EDITS performances. Finally, the obtained results and error analysis are discussed.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11582/5350
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact