Analysis of hand-crafted and learned feature extraction methods for real-Time facial expression recognition

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Scopus citations

Abstract

This paper presents an analysis of hand-crafted and learned feature extraction methods for real-Time facial expression recognition (FER). Our analysis focuses on methods capable of running on mobile devices, including traditional algorithms such as Gabor transform, HOG, LBP, as well as two compact CNN models, named Mobilenet V1 and V2. Additionally, we test the performance of MOTIF, a highly efficient texture feature extractor algorithm. Furthermore, we analyze the contribution of the mouth and front-eyes regions for recognizing the seven basic facial expressions. Experimental results are evaluated on two publicly available datasets. KDEF database which was captured under controlled conditions and RAF database which represents more naturalistic expressions captured in-The-wild. Under the same experimental conditions, MOTIF presents the fastest performance by sacrificing accuracy, while Mobilenet V2 presents the highest results with considerable speed and model size.

Original languageEnglish
Title of host publication2019 7th International Workshop on Biometrics and Forensics, IWBF 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728106229
DOIs
StatePublished - May 2019
Event7th International Workshop on Biometrics and Forensics, IWBF 2019 - Cancun, Mexico
Duration: 2 May 20193 May 2019

Publication series

Name2019 7th International Workshop on Biometrics and Forensics, IWBF 2019

Conference

Conference7th International Workshop on Biometrics and Forensics, IWBF 2019
Country/TerritoryMexico
CityCancun
Period2/05/193/05/19

Keywords

  • MOTIF
  • Mobile applications
  • Mobilenets
  • ROI
  • facial expression recognition

Fingerprint

Dive into the research topics of 'Analysis of hand-crafted and learned feature extraction methods for real-Time facial expression recognition'. Together they form a unique fingerprint.

Cite this