DaDoEval @ EVALITA 2020: Same-genre and cross-genre dating of historical documents

Stefano Menini*, Giovanni Moretti, Rachele Sprugnoli, Sara Tonelli

*Corresponding author

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this paper we introduce the DaDoEval shared task at EVALITA 2020, aimed at automatically assigning temporal information to documents written in Italian. The evaluation exercise comprises three levels of temporal granularity, from coarse-grained to year-based, and includes two types of test sets, either having the same genre of the training set, or a different one. More specifically, DaDoEval deals with the corpus of Alcide De Gasperi's documents, providing both public documents and letters as test sets. Two systems participated in the competition, achieving results always above the baseline in all subtasks. As expected, coarse-grained classification into five periods is rather easy to perform automatically, while the year-based one is still an unsolved problem also due to the lack of enough training data for some years. Results showed also that, although De Gasperi's letters in our test set were written in standard Italian and in a style which was not too colloquial, cross-genre classification yields remarkably lower results than the same-genre setting.
Original languageEnglish
Title of host publicationProceedings of the Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2020)
Pages391-397
Number of pages7
Publication statusPublished - 2020
Event7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. EVALITA 2020 - Online
Duration: 17 Dec 202017 Dec 2020

Workshop

Workshop7th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. EVALITA 2020
CityOnline
Period17/12/2017/12/20

Keywords

  • Natural Language Processing
  • computational linguistics
  • evaluation

Fingerprint

Dive into the research topics of 'DaDoEval @ EVALITA 2020: Same-genre and cross-genre dating of historical documents'. Together they form a unique fingerprint.

Cite this