摘要
动态手势识别作为人机交互的一个重要方向,在各个领域具有广泛的需求。相较于静态手势,动态手势的变化更为复杂,对其特征的充分提取与描述是准确识别动态手势的关键。为了解决对动态手势特征描述不充分的问题,利用高精度的Leap Motion传感器对手部三维坐标信息进行采集,提出了一种包含手指姿势和手掌位移的特征在内的、能够充分描述复杂动态手势的特征序列,并结合长短期记忆网络模型进行动态手势识别。实验结果表明,提出的方法在包含16种动态手势的数据集上的识别准确率为98.50%;与其他特征序列的对比实验表明,提出的特征序列,能更充分准确地描述动态手势特征。
Dynamic gesture recognition is one of the most important topics in human-computer interaction. Compared with static gestures, the change of dynamic gestures is more complicated. The full extraction and description of dynamic gesture features is the key to accurately identify dynamic gestures. In order to solve the problem of insufficient description of dynamic gesture features and low recognition efficiency, this paper proposes a feature sequence that can fully describe dynamic gestures and realize effective description of dynamic gestures. High-precision Leap Motion sensor is used to acquire hand parameters diametrically. A sequence feature including fingertips angles, fingertips distances, fingertips elevations and palm speed is proposed. In addition, the sequence is combined with Long Short-Term Memory(LSTM) network model for dynamic gesture recognition. And by analyzing the experimental results on the dynamic gesture dataset, a dataset containing 16 dynamic gestures is collected by Leap Motion, which contains complex finger changes and hand movements. The dataset is named LM-16. The experimental results show that the recognition accuracy of this method for the LM-16 dataset is 98.50%. Furthermore, experiments are carried out by using other feature sequences to compare the influence of feature sequences on dynamic gestures recognition.
作者
孙玉
袁贞明
孙晓燕
SUN Yu;YUAN Zhenming;SUN Xiaoyan(Hangzhou Institute of Service Engineering,Hangzhou Normal University,Hangzhou 311121,China;Engineering Research Center of Mobile Health Management System,Ministry of Education,Hangzhou 311121,China)
出处
《计算机工程与应用》
CSCD
北大核心
2019年第13期151-157,共7页
Computer Engineering and Applications
基金
浙江省自然科学基金(No.LQ16H180004)
作者简介
孙玉(1990—),女,硕士研究生,主要研究领域为手势识别,E-mail:sunwangdian@163.com;袁贞明(1972-),男,博士,教授,研究领域为模式识别与机器学习、多媒体信息检索与分析、医学信息系统、地理信息系统等;孙晓燕(1980-),女,博士,讲师,研究领域为图像引导的手术规划及手术导航、基于增强现实的辅助训练、医学信息可视化、无干扰化健康监测等。
