Semantic textual similarity methods, tools, and applications: A survey

Goutam Majumder, Partha Pakray, Alexander Gelbukh, David Pinto

Research output: Contribution to journalArticlepeer-review

49 Scopus citations

Abstract

Measuring Semantic Textual Similarity (STS), between words/terms, sentences, paragraph and document plays an important role in computer science and computational linguistic. It also has many applications over several fields such as Biomedical Informatics and Geoinformation. In this paper, we present a survey on different methods of textual similarity and we also reported about the availability of different software and tools those are useful for STS. In natural language processing (NLP), STS is a important component for many tasks such as document summarization, word sense disambiguation, short answer grading, information retrieval and extraction. We split out the measures for semantic similarity into three broad categories such as (i) Topological/Knowledge-based (ii) Statistical/Corpus Based (iii) String based. More emphasis is given to the methods related to the WordNet taxonomy. Because topological methods, plays an important role to understand intended meaning of an ambiguous word, which is very difficult to process computationally. We also propose a new method for measuring semantic similarity between sentences. This proposed method, uses the advantages of taxonomy methods and merge these information to a language model. It considers the WordNet synsets for lexical relationships between nodes/words and a uni-gram language model is implemented over a large corpus to assign the information content value between the two nodes of different classes.

Original languageEnglish
Pages (from-to)647-665
Number of pages19
JournalComputacion y Sistemas
Volume20
Issue number4
DOIs
StatePublished - 2016

Keywords

  • Character-based similarity
  • Cosine similarity
  • Information content
  • Jaccard similarity
  • N-gram
  • Natural language processing
  • Random walk
  • Semantic textual similarity
  • Statistical similarity
  • Term-based similarity
  • WordNet similarity
  • WordNet taxonomy

Fingerprint

Dive into the research topics of 'Semantic textual similarity methods, tools, and applications: A survey'. Together they form a unique fingerprint.

Cite this