Multimodal Feedback in Assisting a Wearable Brain-Computer Interface Based on Motor Imagery

Pasquale Arpaia, Damien Coyle, Francesco Donnarumma, Antonio Esposito, Angela Natalizio, Marco Parvis, Marisa Pesola, Ersilia Vallefuoco

Research output: Chapter or section in a book/report/conference proceedingChapter in a published conference proceeding

3 Citations (SciVal)

Abstract

A multimodal sensory feedback was exploited in the present study to improve the detection of neurological phenomena associated with motor imagery. At this aim, visual and haptic feedback were simultaneously delivered to the user of a brain-computer interface. The motor imagery-based brain-computer interface was built by using a wearable and portable electroencephalograph with only eight dry electrodes, a haptic suit, and a purposely implemented virtual reality application. Preliminary experiments were carried out with six subjects participating in five sessions on different days. The subjects were randomly divided into “control group” and “neurofeedback group”. The former performed pure motor imagery without receiving any feedback, while the latter received multimodal feedback as a response to their imaginative act. Results of a cross validation showed that at most 61% of classification accuracy was achieved in performing the pure motor imagination. On the contrary, subjects of the “neurofeedback group” achieved up to 82% mean accuracy, with a peak of 91% in one of the sessions. However, no improvement in pure motor imagery was observed, either when practicing with pure motor imagery or with feedback.
Original languageEnglish
Title of host publication2022 IEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)
Place of PublicationUnited States
Publisher IEEE Transactions on Medical Imaging
Pages691-696
Number of pages6
ISBN (Print)978-1-6654-8575-3
DOIs
Publication statusPublished - 5 Dec 2022
EventIEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE), MetroXRAINE - Rome, Italy
Duration: 19 Oct 202228 Oct 2022

Conference

ConferenceIEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE), MetroXRAINE
Country/TerritoryItaly
CityRome
Period19/10/2228/10/22

Keywords

  • brain-computer interface
  • motor imagery
  • electroencephalography
  • extended reality
  • neurofeedback
  • wearability
  • dry electrodes

Fingerprint

Dive into the research topics of 'Multimodal Feedback in Assisting a Wearable Brain-Computer Interface Based on Motor Imagery'. Together they form a unique fingerprint.

Cite this