65 / 2021-10-16 17:58:42
Multimodal fusion diagnosis of depression and anxiety based on face video
Depression detection, Anxiety detection, Face video, Long Short-Term Memory Networks,Classification
终稿
Chen Wang / Harbin Engineering University
Lizhong Liang / Sun Yat-Sen University;Marine Biomedical Research Institute of Guangdong
Xiaofeng Liu / Harvard Medical School;Suzhou Fanhan Information Technology Co., Ltd
Yao Lu / Sun Yat-Sen University;Marine Biomedical Research Institute of Guangdong
Jihong Shen / Harbin Engineering University
Hui Luo / Southern Marine Science and Engineering Guangdong Laboratory;Marine Biomedical Research Institute of Guangdong
Wanqing Xie / Harbin Engineering University;Suzhou Fanhan Information Technology Co., Ltd
In order to diagnose depression and anxiety, clinicians will conduct interviews with subjects. If large-scale screening is carried out, this method is too costly and difficult to implement. Because facial expressions play an important role in the diagnosis of clinicians, this provides an opportunity to solve this problem. Therefore, we recorded 303 subjects who answered the self-rated anxiety scale (SAS) and the self-rated depression scale (SDS) Video. Based on Convolutional Neural Networks (CNN) and Long Short-Term Memory Networks (LSTM), by using either of these two types of videos alone as a binary classification experiment, the accuracy of the diagnosis of depression is 72.53%, and the diagnosis of anxiety is 72.08%. In addition, by fusing the two types of videos to diagnose anxiety, depression, and normal in three categories, the accuracy of the model is 80.22%. Through the comparison of the results, the multimodal fusion diagnosis can not only diagnose the three categories but also has the highest accuracy. This model can be deployed on smartphones, not only for large-scale screening but also to assist doctors in diagnosis.

 
重要日期
  • 会议日期

    11月13日

    2021

    11月14日

    2021

  • 09月30日 2021

    报告提交截止日期

  • 11月14日 2021

    注册截止日期

主办单位
IEEE北京分会
中国生物医学工程学会医学物理分会
中国电子学会生命电子学分会
承办单位
中国科学技术大学
安徽省生物医学工程学会
联系方式
移动端
在手机上打开
小程序
打开微信小程序
客服
扫码或点此咨询