Articolo in rivista, 2023, ENG, 10.1007/s10618-023-00961-5

SALt: efficiently stopping TAR by improving priors estimates

Molinari A.; Esuli A.

CNR-ISTI, Pisa, Italy; CNR-ISTI, Pisa, Italy

In high recall retrieval tasks, human experts review a large pool of documents with the goal of satisfying an information need. Documents are prioritized for review through an active learning policy, and the process is usually referred to as Technology-Assisted Review (TAR). TAR tasks also aim to stop the review process once the target recall is achieved to minimize the annotation cost. In this paper, we introduce a new stopping rule called SALR? (SLD for Active Learning), a modified version of the Saerens-Latinne-Decaestecker algorithm (SLD) that has been adapted for use in active learning. Experiments show that our algorithm stops the review well ahead of the current state-of-the-art methods, while providing the same guarantees of achieving the target recall.

Data mining and knowledge discovery (Dordrecht. Online)

Keywords

Technology assisted review, Machine Learning, Text classification, Active learning

CNR authors

Molinari Alessio, Esuli Andrea

CNR institutes

ISTI – Istituto di scienza e tecnologie dell'informazione "Alessandro Faedo"