Gaze-Informed egocentric action recognition for memory aid systems

Zheming Zuo, Longzhi Yang, Yonghong Peng, Fei Chao, Yanpeng Qu

Allbwn ymchwil: Cyfraniad at gyfnodolynErthygladolygiad gan gymheiriaid

26 Dyfyniadau(SciVal)
159 Wedi eu Llwytho i Lawr (Pure)


Egocentric action recognition has been intensively studied in the fields of computer vision and clinical science with applications in pervasive health-care. The majority of the existing egocentric action recognition techniques utilize the features extracted from either the entire contents or the regions of interest (ROI) in video frames as the inputs of action classifiers. The former might suffer from moving backgrounds or irrelevant foregrounds usually associated with egocentric action videos, while the latter may be impaired by the mismatch between the calculated and the ground truth ROI. This paper proposes a new gaze-informed feature extraction approach, by which the features are extracted from the regions around the gaze points and thus representing the genuine ROI from a first person of view. The activity of daily life can then be classified based only on the identified regions using the extracted gaze-informed features. The proposed approach has been further applied to a memory support system for people with poor memory, such as those with amnesia or dementia, and their carers. The experimental results demonstrate the efficacy of the proposed approach in egocentric action recognition, and thus the potential of the memory support tool in health care.
Iaith wreiddiolSaesneg
Tudalennau (o-i)12894-12904
Nifer y tudalennau11
CyfnodolynIEEE Access
Dynodwyr Gwrthrych Digidol (DOIs)
StatwsCyhoeddwyd - 01 Maw 2018

Ôl bys

Gweld gwybodaeth am bynciau ymchwil 'Gaze-Informed egocentric action recognition for memory aid systems'. Gyda’i gilydd, maen nhw’n ffurfio ôl bys unigryw.

Dyfynnu hyn