loading page

High Performance Wearable Ultrasound as a Human Machine Interface for wrist and hand kinematic tracking
  • +5
  • Bruno Grandi Sgambato ,
  • Milia Hasbani ,
  • Deren Y Barsakcioglu ,
  • Jaime Ibáñez ,
  • Anette Jakob ,
  • Marc Fournelle ,
  • Meng-Xing Tang ,
  • Dario Farina
Bruno Grandi Sgambato
Author Profile
Milia Hasbani
Author Profile
Deren Y Barsakcioglu
Author Profile
Jaime Ibáñez
Author Profile
Anette Jakob
Author Profile
Marc Fournelle
Author Profile
Meng-Xing Tang
Author Profile
Dario Farina
Author Profile

Abstract

Objective: Non-invasive human machine interfaces (HMIs) have high potential in medical, entertainment, and industrial applications. Traditionally, surface electromyography (sEMG) has been used to track muscular activity and infer motor intention. As an alternative HMI approach, ultrasound (US) has been receiving increasing attention as an alternative to EMG. Here, we developed a novel portable US armband system with 24 channels and a multiple receiver approach and compared it with existing sEMG- and US-based HMIs on movement intention decoding.
Methods: US and motion capture data was recorded while participants performed wrist and hand movements in up to four degrees of freedom (DoFs). A linear regression model was then used to predict the hand kinematics from the US (or sEMG, for comparison) features. The model was also implemented in real-time for a 3-DoF pointer control with minimal training data.
Results: In offline analysis, the wearable US system achieved an average of 0.94 in the prediction of four DoFs of the wrist and hand. sEMG reached a performance of   = 0.60.
Conclusion: The newly proposed A-mode US bracelet setup and processing pipeline can regress hand kinematics for up to four DoFs with higher accuracies than other previously published interfaces based on sEMG or US data. The system allowed real-time control with minimal training data
Significance: Wearable US technology may provide a new generation of HMIs that use muscular deformation to estimate limb movements. The proposed US system here provided robust proportional and simultaneous control over multiple DoFs.