A syntactic textual entailment system based on dependency parser

Partha Pakray, Alexander Gelbukh, Sivaji Bandyopadhyay

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

The development of a syntactic textual entailment system that compares the dependency relations in both the text and the hypothesis has been reported. The Stanford Dependency Parser has been run on the 2-way RTE-3 development set and the dependency relations obtained for a text and hypothesis pair has been compared. Some of the important comparisons are: subject-subject comparison, subject-verb comparison, object-verb comparison and cross subject-verb comparison. Corresponding verbs are further compared using the WordNet. Each of the matches is assigned some weight learnt from the development corpus. A threshold has been set on the fraction of matching hypothesis relations based on the development set. The threshold score has been applied on the RTE-4 gold standard test set using the same methods of dependency parsing followed by comparisons. Evaluation scores obtained on the test set show 54.75% precision and 53% recall for YES decisions and 54.45% precision and 56.2% recall for NO decisions.

Original languageEnglish
Title of host publicationComputational Linguistics and Intelligent Text Processing - 11th International Conference, CICLing 2010, Proceedings
Pages269-278
Number of pages10
DOIs
StatePublished - 2010
Event11th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2010 - Iasi, Romania
Duration: 21 Mar 201027 Mar 2010

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume6008 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference11th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2010
Country/TerritoryRomania
CityIasi
Period21/03/1027/03/10

Keywords

  • Dependency parsing
  • Dependency relations
  • RTE-3 development set
  • RTE-4 gold standard test set
  • Textual entailment

Fingerprint

Dive into the research topics of 'A syntactic textual entailment system based on dependency parser'. Together they form a unique fingerprint.

Cite this