This paper overviews FBK's participation in the RTE-7 Main task organized within the Text Analysis Conference (TAC) 2011. Our participation is character-ized by two main themes, namely: 1. The attempt to move from token-level overlap measures (i.e. a count of the terms in the hypothesis that can be mapped to terms in the Text), to phrase-level overlap measures that take into account a larger context to favour sys-tem's precision; 2. The attempt to use paraphrase tables derived from parallel data as the main source of lexical knowledge for the mapping. In contrast with previous experiments over different datasets on one side, and the scores achieved over the RTE-7 DEV SET on the other side, our final results are lower than those obtained with the simpler token-overlap algorithm (41.90% Vs 44.1% Micro-Averaged F-measure). The motivations for this unexpected per-formance drop are still under investigation.

FBK Participation in the RTE-7 Main Task

Yashar Mehdad;José Guilherme Camargo de Souza;Matteo Negri;Alina Petrova
2011

Abstract

This paper overviews FBK's participation in the RTE-7 Main task organized within the Text Analysis Conference (TAC) 2011. Our participation is character-ized by two main themes, namely: 1. The attempt to move from token-level overlap measures (i.e. a count of the terms in the hypothesis that can be mapped to terms in the Text), to phrase-level overlap measures that take into account a larger context to favour sys-tem's precision; 2. The attempt to use paraphrase tables derived from parallel data as the main source of lexical knowledge for the mapping. In contrast with previous experiments over different datasets on one side, and the scores achieved over the RTE-7 DEV SET on the other side, our final results are lower than those obtained with the simpler token-overlap algorithm (41.90% Vs 44.1% Micro-Averaged F-measure). The motivations for this unexpected per-formance drop are still under investigation.
File in questo prodotto:
File Dimensione Formato  
FBK_irst.proceedings.pdf

accesso aperto

Tipologia: Documento in Post-print
Licenza: DRM non definito
Dimensione 192.22 kB
Formato Adobe PDF
192.22 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11582/313151
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact