Adaptive algorithm for plagiarism detection: The best-performing approach at PAN 2014 text alignment competition

Miguel A. Sanchez-Perez, Alexander Gelbukh, Grigori Sidorov

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

17 Scopus citations

Abstract

The task of (monolingual) text alignment consists in finding similar text fragments between two given documents. It has applications in plagiarism detection, detection of text reuse, author identification, authoring aid, and information retrieval, to mention only a few. We describe our approach to the text alignment subtask of the plagiarism detection competition at PAN 2014, which resulted in the best performing system at the PAN 2014 competition and outperforms the best-performing system of the PAN 2013 competition by the cumulative evaluation measure Plagdet. Our method relies on a sentence similarity measure based on a tf-idf-like weighting scheme that permits us to consider stopwords without increasing the rate of false positives. We introduce a recursive algorithm to extend the ranges of matching sentences to maximal length passages. We also introduce a novel filtering method to resolve overlapping plagiarism cases. Our system is available as open source.

Original languageEnglish
Title of host publicationExperimental IR Meets Multilinguality, Multimodality, and Interaction - 6th International Conference of the CLEF Association, CLEF 2015, Proceedings
EditorsEric San Juan, Jacques Savoy, Josiane Mothe, Jaap Kamps, Gareth J.F. Jones, Nicola Ferro, Karen Pinel-Sauvagnat, Linda Cappellato
PublisherSpringer Verlag
Pages402-413
Number of pages12
ISBN (Print)9783319240268
DOIs
StatePublished - 2015
Event6th International Conference on Labs of the Evaluation Forum, CLEF 2015 - Toulouse, France
Duration: 8 Sep 201511 Sep 2015

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9283
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference6th International Conference on Labs of the Evaluation Forum, CLEF 2015
Country/TerritoryFrance
CityToulouse
Period8/09/1511/09/15

Fingerprint

Dive into the research topics of 'Adaptive algorithm for plagiarism detection: The best-performing approach at PAN 2014 text alignment competition'. Together they form a unique fingerprint.

Cite this