Real-time feedback improves imagined 3D primitive object classification from EEG

Attila Korik, Naomi Du Bois, Gerard Campbell, Eamonn O'Neill, Laura Hay, Sam Gilbert, Madeleine Grealy, Damien Coyle

Research output: Contribution to journalArticlepeer-review

428 Downloads (Pure)

Abstract

Brain-computer interfaces (BCI) enable movement-independent information transfer from humans to computers. Decoding imagined 3D objects from electroencephalography (EEG) may improve design ideation in engineering design or image reconstruction from EEG for application in brain-computer interfaces, neuro-prosthetics, and cognitive neuroscience research. Object-imagery decoding studies, to date, predominantly employ functional magnetic resonance imaging (fMRI) and do not provide real-time feedback. We present four linked studies in a study series to investigate: (1) whether five imagined 3D primitive objects (sphere, cone, pyramid, cylinder, and cube) could be decoded from EEG; and (2) the influence of real-time feedback on decoding accuracy. Studies 1 (N=10) and 2 (N=3) involved a single-session and a multi-session design, respectively, without real-time feedback. Studies 3 (N=2) and 4 (N=4) involved multiple sessions, without and with real-time feedback. The four studies involved 69 sessions in total of which 26 sessions were online with real-time feedback (15,480 trials for offline and at least 6,840 trials for online sessions in total). We demonstrate that decoding accuracy over multiple sessions improves significantly with biased feedback (p=0.004), compared to performance without feedback. This is the first study to show the effect of real-time feedback on the performance of primitive object-imagery BCI.
Original languageEnglish
Pages (from-to)61-85
Number of pages25
JournalBrain-Computer Interfaces
Volume11
Issue number1-2
Early online date27 Mar 2024
DOIs
Publication statusPublished - 31 Dec 2024

Data Availability Statement

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Funding

This research has been supported by the UK Engineering and Physical Sciences Research Council (EPSRC) under Grant numbers EP/M01214X/1 and EP/M012123/1; The access to the Tier 2 High Performance Computing resources provided by the Northern Ireland High Performance Computing (NI-HPC) facility funded by the UK EPSRC under Grant number EP/T022175; the UKRI Turing AI Fellowship 2021-2025 funded by the EPSRC under Grant number EP/V025724/1; and the Spatial Computing and Neurotechnology Innovation Hub, funded by The Department for the Economy, Northern Ireland.

Keywords

  • Brain-computer interface (BCI)
  • electroencephalography (EEG)
  • filter-bank common spatial patterns (FBCSP)
  • imagined 3D objects
  • real-time signal processing

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Electrical and Electronic Engineering
  • Behavioral Neuroscience
  • Biomedical Engineering

Fingerprint

Dive into the research topics of 'Real-time feedback improves imagined 3D primitive object classification from EEG'. Together they form a unique fingerprint.

Cite this