We present a tool for annotation of linguistic data. AnnotatorPro offers both complete monitoring functionalities (e.g. inter-annotator agreement and agreement with respect to a gold standard) and highly flexible task design (e.g. token and document level annotation, adjudication and reconciliation procedures). We tested AnnotatorPro in several industrial annotation scenarios, coupled with Active Learning techniques.

Find Problems before They Find You with AnnotatorPro's Monitoring Functionalities

Mohammed R. H. Qwaider;Anne-Lyse Minard;Manuela Speranza;Bernardo Magnini
2017-01-01

Abstract

We present a tool for annotation of linguistic data. AnnotatorPro offers both complete monitoring functionalities (e.g. inter-annotator agreement and agreement with respect to a gold standard) and highly flexible task design (e.g. token and document level annotation, adjudication and reconciliation procedures). We tested AnnotatorPro in several industrial annotation scenarios, coupled with Active Learning techniques.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11582/315125
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact