联系我们
意见反馈

关注公众号

获得最新科研资讯

金博数据挖掘实验室

简介 主要研究方向为医疗健康大数据分析、智能产品创新设计与专利挖掘等

分享到

Diagnosing Parkinson Disease Through Facial Expression Recognition: Video Analysis

2020
期刊 Journal of Medical Internet Research
作者 Bo Jin · Yue Qu · Liang Zhang · Zhan Gao
Background The number of patients with neurological diseases is currently increasing annually, which presents tremendous challenges for both patients and doctors. With the advent of advanced information technology, digital medical care is gradually changing the medical ecology. Numerous people are exploring new ways to receive a consultation, track their diseases, and receive rehabilitation training in more convenient and efficient ways. In this paper, we explore the use of facial expression recognition via artificial intelligence to diagnose a typical neurological system disease, Parkinson disease (PD). Objective This study proposes methods to diagnose PD through facial expression recognition. Methods We collected videos of facial expressions of people with PD and matched controls. We used relative coordinates and positional jitter to extract facial expression features (facial expression amplitude and shaking of small facial muscle groups) from the key points returned by Face++. Algorithms from traditional machine learning and advanced deep learning were utilized to diagnose PD. Results The experimental results showed our models can achieve outstanding facial expression recognition ability for PD diagnosis. Applying a long short-term model neural network to the positions of the key features, precision and F1 values of 86% and 75%, respectively, can be reached. Further, utilizing a support vector machine algorithm for the facial expression amplitude features and shaking of the small facial muscle groups, an F1 value of 99% can be achieved. Conclusions This study contributes to the digital diagnosis of PD based on facial expression recognition. The disease diagnosis model was validated through our experiment. The results can help doctors understand the real-time dynamics of the disease and even conduct remote diagnosis.

  • 卷 22
  • 期 7
  • 页码 e18697
  • JMIR Publications Inc.
  • ISSN: 1438-8871
  • DOI: 10.2196/18697