A multi-modal model-fusion approach for improved prediction of Freezing of Gait in Parkinson’s disease

Freezing of gait (FoG) is a widely observed movement disorder in Parkinson’s Disease patients (PD). Its prediction is crucial for effectively giving the cue to avoid FoG occurrence. However, present methods of prediction of FoG are inaccurate for large but practical prediction horizons (PH)s. Therefore, this work presents a comprehensive analysis of the electroencephalography (EEG) and inertial measurement units (IMU)s to predict FoG advance in time. An ensemble model consisting of two neural networks, EEGFoGNet and IMUFoGNet, was developed and tested at different PHs and ensemble weights. Moreover, the model is tested for two practical scenarios: clinical or research applications and personal uses. For clinical or research applications, stratified 5-Folds cross-validation was used. For personal uses, a transfer learning technique was used for learning user-specific FoG-related features. The model obtained the best accuracy of 92.1% at 1 second’s PH and the least accuracy of 86.2% at 5 seconds’ PH. The presented results are encouraging and show the proposed model’s clinical applicability. This study will also help practitioners in comparing the efficacy of different cueing methods.