TY - GEN
T1 - Human functional pattern recognition with focus on hand detection in egocentric vision through an artificial intelligence approach
AU - Babatope, Eyitomilayo Yemisi
AU - López-Rodríguez, Mario
AU - Acosta-Franco, Jesus Alejandro
AU - García-Vázquez, Mireya Saraí
AU - Ramírez-Acosta, Alejandro Álvaro
N1 - Publisher Copyright:
© 2022 SPIE.
PY - 2022
Y1 - 2022
N2 - Good health and functional ability are important for individuals to lead fulfilling mental, psychological, and social lives. The diseases such as Dementia causes irreversible damage, decline in cognition, function, and behavior which translates into difficulty in independently performing daily tasks. Studies showed that assessment of Instrumental activities of daily living(IADLs) correlate with humans' cognitive and functional status. Analysis of biomechanical markers such as hand movement/use was done with artificial intelligence(AI). We present an optimized AI algorithm for hand detection in the analysis of egocentric video recordings. This improved AI algorithm is based on a probabilistic approach where hand regions are detected in egocentric videos. They then feed the human functional pattern recognition process. To evaluate the performance of our proposal we use a dataset containing the four functional patterns organized into four classes, based on the prehensile patterns of the hands: strength-precision, and on the kinematics of the instruments: displacement-handling. This work was inspired by a previous work done by our group, where biomechanical markers were analyzed throughout the performance of IADL activities to recognize the human functional pattern. The result of our proposal yielded an accuracy of 87.5% in recognizing strength-precision and displacement-handling movement patterns when evaluating the test database with information from Segmented and Not-Segmented videos. This resulted in a single video that changed its classification ratio between the two subsets. This can be of great potential in the development of technological tools for the creation of an automated model to support the diagnosis of early Alzheimer's disease.
AB - Good health and functional ability are important for individuals to lead fulfilling mental, psychological, and social lives. The diseases such as Dementia causes irreversible damage, decline in cognition, function, and behavior which translates into difficulty in independently performing daily tasks. Studies showed that assessment of Instrumental activities of daily living(IADLs) correlate with humans' cognitive and functional status. Analysis of biomechanical markers such as hand movement/use was done with artificial intelligence(AI). We present an optimized AI algorithm for hand detection in the analysis of egocentric video recordings. This improved AI algorithm is based on a probabilistic approach where hand regions are detected in egocentric videos. They then feed the human functional pattern recognition process. To evaluate the performance of our proposal we use a dataset containing the four functional patterns organized into four classes, based on the prehensile patterns of the hands: strength-precision, and on the kinematics of the instruments: displacement-handling. This work was inspired by a previous work done by our group, where biomechanical markers were analyzed throughout the performance of IADL activities to recognize the human functional pattern. The result of our proposal yielded an accuracy of 87.5% in recognizing strength-precision and displacement-handling movement patterns when evaluating the test database with information from Segmented and Not-Segmented videos. This resulted in a single video that changed its classification ratio between the two subsets. This can be of great potential in the development of technological tools for the creation of an automated model to support the diagnosis of early Alzheimer's disease.
KW - Activities of Daily Living
KW - Artificial intelligence
KW - Dementia
KW - Functional decline
KW - Support vector machine
KW - hand detection
UR - http://www.scopus.com/inward/record.url?scp=85141750158&partnerID=8YFLogxK
U2 - 10.1117/12.2632894
DO - 10.1117/12.2632894
M3 - Contribución a la conferencia
AN - SCOPUS:85141750158
T3 - Proceedings of SPIE - The International Society for Optical Engineering
BT - Optics and Photonics for Information Processing XVI
A2 - Awwal, Abdul A. S.
A2 - Iftekharuddin, Khan M.
A2 - Diaz-Ramirez, Victor Hugo
PB - SPIE
T2 - Optics and Photonics for Information Processing XVI 2022
Y2 - 24 August 2022
ER -