Abstract
In this paper we introduce the DaDoEval shared task at EVALITA 2020, aimed at automatically assigning temporal information to documents written in Italian. The evaluation exercise comprises three levels of temporal granularity, from coarse-grained to year-based, and includes two types of test sets, either having the same genre of the training set, or a different one. More specifically, DaDoEval deals with the corpus of Alcide De Gasperi's documents, providing both public documents and letters as test sets. Two systems participated in the competition, achieving results always above the baseline in all subtasks. As expected, coarse-grained classification into five periods is rather easy to perform automatically, while the year-based one is still an unsolved problem also due to the lack of enough training data for some years. Results showed also that, although De Gasperi's letters in our test set were written in standard Italian and in a style which was not too colloquial, cross-genre classification yields remarkably lower results than the same-genre setting.
Lingua originale | English |
---|---|
Titolo della pubblicazione ospite | Proceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2020) |
Pagine | 391-397 |
Numero di pagine | 7 |
Stato di pubblicazione | Pubblicato - 2020 |
Evento | 7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. EVALITA 2020 - Online Durata: 17 dic 2020 → 17 dic 2020 |
Workshop
Workshop | 7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. EVALITA 2020 |
---|---|
Città | Online |
Periodo | 17/12/20 → 17/12/20 |
Keywords
- Natural Language Processing
- computational linguistics
- evaluation