Dynamically adjustable approach through obfuscation type recognition

Miguel A. Sanchez-Perez, Alexander Gelbukh, Grigori Sidorov

Research output: Contribution to journalConference articlepeer-review

2 Scopus citations

Abstract

The task of (monolingual) text alignment consists in finding similar text fragments between two given documents. It has applications in plagiarism detection, detection of text reuse, author identification, authoring aid, and information retrieval, to mention only a few. We describe our approach to the text alignment subtask of the plagiarism detection competition at PAN 2015. Our method relies on a sentence similarity measure based on a tf-idf-like weighting scheme and cosine and dice similarity measures. We used and extended our previous algorithm for clustering and introduced a new verbatim detection method and extended the decision making regarding which approach or output to use. We improve significantly the performance regarding our previous PAN 2014 approach and hence, our approach outperforms the best-performing system of the PAN 2014. Our system is available open source.

Original languageEnglish
JournalCEUR Workshop Proceedings
Volume1391
StatePublished - 2015
Event16th Conference and Labs of the Evaluation Forum, CLEF 2015 - Toulouse, France
Duration: 8 Sep 201511 Sep 2015

Fingerprint

Dive into the research topics of 'Dynamically adjustable approach through obfuscation type recognition'. Together they form a unique fingerprint.

Cite this