SOFTCARDINALITY: Hierarchical text overlap for student response analysis

Sergio Jimenez, Claudia Becerra, Alexander Gelbukh

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

34 Scopus citations

Abstract

In this paper we describe our system used to participate in the Student-Response-Analysis task-7 at SemEval 2013. This system is based on text overlap through the soft cardinality and a new mechanism for weight propagation. Although there are several official performance measures, taking into account the overall accuracy throughout the two availabe data sets (Beetle and SciEntsBank), our system ranked first in the 2 way classification task and second in the others. Furthermore, our system performs particularly well with “unseen-domains” instances, which was the more challenging test set. This paper also describes another system that integrates this method with the lexical-overlap baseline provided by the task organizers obtaining better results than the best official results. We concluded that the soft cardinality method is a very competitive baseline for the automatic evaluation of student responses.

Original languageEnglish
Title of host publication*SEM 2013 - 2nd Joint Conference on Lexical and Computational Semantics
PublisherAssociation for Computational Linguistics (ACL)
Pages280-284
Number of pages5
ISBN (Electronic)9781937284497
StatePublished - 2013
Event2nd Joint Conference on Lexical and Computational Semantics, *SEM 2013 - Atlanta, United States
Duration: 13 Jun 201314 Jun 2013

Publication series

Name*SEM 2013 - 2nd Joint Conference on Lexical and Computational Semantics
Volume2

Conference

Conference2nd Joint Conference on Lexical and Computational Semantics, *SEM 2013
Country/TerritoryUnited States
CityAtlanta
Period13/06/1314/06/13

Fingerprint

Dive into the research topics of 'SOFTCARDINALITY: Hierarchical text overlap for student response analysis'. Together they form a unique fingerprint.

Cite this