文献类型： 会议论文

第一作者： Kevin Feghoul

作者： Kevin Feghoul ¹ ; Deise Santana Maia ² ; Mehdi El Amrani ³ ; Mohamed Daoudi ² ; Ali Amad ¹ ;

作者机构： 1.Univ. Lille, Inserm, CHU Lille, UMR-S1172 LilNCog

2.Univ. Lille, CNRS, Centrale Lille, UMR 9189 CRIStAL

3.Department of Digestive Surgery and Transplantation, CHU Lille, PRESAGE, Univ. Lille

关键词： Graph convolutional networks;Transformer;Surgical skill assessment;Hand skeleton;Simulation;Education

会议名称： Iberoamerican Congress on Pattern Recognition

主办单位：

页码： 287-297

摘要： Automatic surgical skill assessment has the capacity to bring a transformative shift in the assessment, development, and enhancement of surgical proficiency. It offers several advantages, including objectivity, precision, and real-time feedback. These benefits will greatly enhance the development of surgical skills for novice surgeons, enabling them to improve their abilities in a more effective and efficient manner. In this study, our primary objective was to explore the potential of hand skeleton dynamics as an effective means of evaluating surgical proficiency. Specifically, we aimed to discern between experienced surgeons and surgical residents by analyzing sequences of hand skeletons. To the best of our knowledge, this study represents a pioneering approach in using hand skeleton sequences for assessing surgical skills. To effectively capture the spatial-temporal correlations within sequences of hand skeletons for surgical skill assessment, we present STGFormer, a novel approach that combines the capabilities of Graph Convolutional Networks and Transformers. STGFormer is designed to learn advanced spatial-temporal representations and efficiently capture long-range dependencies. We evaluated our proposed approach on a dataset comprising experienced surgeons and surgical residents practicing surgical procedures in a simulated training environment. Our experimental results demonstrate that the proposed STGFormer outperforms all state-of-the-art models for the task of surgical skill assessment. More precisely, we achieve an accuracy of 83.29% and a weighted average F1-score of 81.41%. These results represent a significant improvement of 1.37% and 1.28% respectively when compared to the best state-of-the-art model.

分类号： tp391.4-53