Answer validation using textual entailment

Partha Pakray, Alexander Gelbukh, Sivaji Bandyopadhyay

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Scopus citations

Abstract

We present an Answer Validation System (AV) based on Textual Entailment and Question Answering. The important features used to develop the AV system are Lexical Textual Entailment, Named Entity Recognition, Question-Answer type analysis, chunk boundary module and syntactic similarity module. The proposed AV system is rule based. We first combine the question and the answer into Hypothesis (H) and the Supporting Text as Text (T) to identify the entailment relation as either "VALIDATED" or "REJECTED". The important features used for the lexical Textual Entailment module in the present system are: WordNet based unigram match, bigram match and skip-gram. In the syntactic similarity module, the important features used are: subject-subject comparison, subject-verb comparison, object-verb comparison and cross subject-verb comparison. The results obtained from the answer validation modules are integrated using a voting technique. For training purpose, we used the AVE 2008 development set. Evaluation scores obtained on the AVE 2008 test set show 66% precision and 65% F-Score for "VALIDATED" decision.

Original languageEnglish
Title of host publicationComputational Linguistics and Intelligent Text Processing - 12th International Conference, CICLing 2011, Proceedings
Pages353-364
Number of pages12
EditionPART 2
DOIs
StatePublished - 2011
Event12th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2011 - Tokyo, Japan
Duration: 20 Feb 201126 Feb 2011

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume6609 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference12th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2011
Country/TerritoryJapan
CityTokyo
Period20/02/1126/02/11

Keywords

  • Answer Validation Exercise (AVE)
  • Chunk Boundary
  • Named Entity (NE)
  • Question Type
  • Syntactic Similarity
  • Textual Entailment (TE)

Fingerprint

Dive into the research topics of 'Answer validation using textual entailment'. Together they form a unique fingerprint.

Cite this