Bringing BCIs to the user’s home for neurorehabilitation and assistive applications
Neurorehabilitation and assistive technologies use brain-computer interfaces (BCIs) to involve the central nervous system in the rehabilitation process or to allow control of technology. Moving BCI-based neurorehabilitation or motor restoration applications from the laboratory to home settings will improve accessibility to therapies and assistive applications. This will increase potential benefits and allow a more intensive data collection to foster scientific progress. The EEG equipment itself has been identified as a key technology required to enable such a transition and to increase acceptance from the end users. We describe a new wearable dry-electrode EEG system specifically designed to ease the transition to the user’s home. This device has an optimized minimal number of sensors for maximum comfort, extremely fast setup time, and carefully designed aesthetics. We’ll present recent results evaluating its performance to decode motor-related brain patterns.
BCIs for motor rehabilitation and restoration
One of the most promising high impact applications of brain-computer interfaces (BCIs) is to restore movement for people who have paralyzed, impaired or diminished motor control of their limbs. This lack of control can be due to several causes including stroke, spinal cord injury (SCI), traumatic brain injury (TBI), Parkinson’s disease, amyotrophic lateral sclerosis, multiple sclerosis, and others. Due to the high prevalence of some of these conditions (e.g., stroke has been identified by the WHO as a health priority (Johnson, 2016)), millions of people worldwide suffer from motor impairments which drastically decrease their autonomy and quality of life. Consider how basic everyday actions such as personal hygiene, feeding, dressing, or socializing are hindered when you cannot grab objects. Patients usually have to rely on family, friends or home health aides to perform daily life activities.
BCIs can help in two different ways: motor rehabilitation and motor restoration.
Motor rehabilitation therapies seek to recover the lost motor capacity to achieve the highest level of function possible. The use of BCIs allows the performance of closed-loop interventions where the brain is properly “synchronized” with the movement of the affected limb. These therapies focus on using the contingent association between brain activation during movement intention and peripheral feedback to facilitate the reorganization of the motor circuitry, and subsequently, promote motor recovery (Jackson & Zimmermann, 2012). For more insights check this post on motor neurorehabilitation.
When rehabilitation is not possible, BCIs can be used for motor restoration. In this case, the main goal is to regain the lost motor function by means of assistive technologies such as prosthesis, stimulators or robotic exo-skeletons controlled by a BCI. A common example is the combined use of EEG equipment to record the brain activity and identify motor-related commands, and functional electrical stimulation (FES) to stimulate the paralyzed muscles in such a way that the patient can grasp an object (Pfurtscheller, 2003).
Transitioning from the lab to the user’s home
Most of the studies and technological prototypes have been designed, developed and evaluated in research laboratories and hospitals. Figure 1 shows some examples from studies carried in R&D neurorehabilitation projects that Bitbrain has participated in.
Figure 1: Examples of current prototypes at research laboratories and hospitals: a BCI controlled exo-skeleton for stroke lower limb rehabilitation from the CORBYS project (left), BCI controlled systems for spinal cord injury at the Hospital Nacional de Paraplejicos in Toledo during the HYPER project (right): incomplete SCI using an exoskeleton for rehabilitation (top) and upper limb stimulation for motor restoration of grasp in complete SCI (bottom).
However, the real ecological settings where these systems ultimately need to work is at home in order to
- Obtain the full potential of the technology:
- Motor neurorehabilitation programs should start as early as possible, probably in a hospital unit, but this becomes highly expensive once the patient is discharged. This results in limited availability, requiring continuous visits to the hospital, which limits the potential number of rehabilitation sessions and, consequently, the recovery potential.
- Motor restoration: the full potential can be obtained only if the user can wear and use the technology in everyday activities.
- Focus on the end user’s needs and improve user acceptance: facing real-world challenges and requirements will help to develop a technology focused on the everyday needs of the users, thus increasing patient and family acceptance.
- Foster scientific progress: bringing usable systems to the end-users’ homes will drastically increase the accessibility of the technology. This allows researchers and clinicians to scale their studies to collect larger amounts of data to better understand the real benefits of these technologies, improve the interventions, and start paving the way for the introduction of additional evidence-based neuro-technology at home.
From Figure 1, we can see that there are some technological challenges to achieve the ecological use of Figure 2 where BCI can be used in everyday activities. The EEG equipment itself has been identified as a key technology required to enable such a transition and to increase acceptance from the end users.
Figure 2: BCIs based rehabilitation and restoration at home should be as minimally invasive as possible, easy to set up and accepted by the end users.
Together with our partners in the MoreGrasp EU project, we implemented a prototype of a BCI device for motor restoration at home. We packed all the technologies into an easy to use application and our SCI participants trained and used the system in their homes with minimal supervision (see Figure 3, the MoreGrasp webpage and our dedicated post).
Figure 3: The Moregrasp project put all the technology in the end users home.
EEG systems are the cornerstone for the effective introduction of BCIs in real-world applications outside the lab, as well as for the effective adoption in user-centered fields. In recent years, there have been strong R&D efforts in developing new EEG technologies with enhanced usability and comfort, without sacrificing reliability and accuracy. Our experience in the MoreGrasp project is that users want comfortable, wearable devices that are easy to set up and also aesthetically pleasing. Missing any of these aspects can reduce user acceptance and can be a barrier to the successful evaluation of the technology at home.
Based on this experience, in the last stages of the MoreGrasp project, we started the development of a novel EEG headset, the Hero, which was created to put the application and the user in the center of the design process. The main characteristics of the headset are:
- Use of a limited number of dry EEG sensors placed strategically over the motor cortex.
- Easy-to-setup EEG headset that can be placed with just one hand in less than two minutes
- Modern aesthetics and ergonomics to increase user’s acceptance.
Figure 4: The Hero headset (top left) has only nine EEG sensors placed over the motor cortex (top right) which makes it possible to self handle it with just one hand and get a good EEG signal in less than two minutes (bottom).
All the ergonomic, aesthetics, and usability effort cannot compromise the technical requirements of the application: signal quality, sensitivity to EEG noise and artifacts, and stability of the sensor contact. So the next question is: Can we measure and decode brain signals with the Hero for motor rehabilitation and restoration?
Measuring brain activation during natural reaching with the HERO.
There are two main brain activity patterns that are normally observed during the actual execution of movements (or the attempt of movement in patients with paralysis):
- Movement-related cortical potentials (MRCPs): this is an event-related potential locked to the onset of the movement. It is characterized in the EEGs’ low-frequency time domain as a negative shift starting approximately 1 second before the movement and reflects neural processes involved in preparing the motor command (Shibasaki and Hallett, 2006).
- Event-related desynchronization/synchronization (ERD/ERS): this reflects the relative power decrease/increase in the ongoing EEG oscillations with respect to a baseline interval before the movement onset. An ERD (i.e., relative power decrease) can be observed in alpha and lower beta bands starting up to 1 second before the movement onset and lasting several seconds after it, reflecting the activation of cortical areas involved in the production of motor behavior (Pfurtscheller, 1999).
It has been previously unclear whether the transition to the end users’ homes utilizing wearable EEG systems based on dry electrodes could be made successfully. In this sense, wearable EEG systems have to allow extracting the brain patterns (MRCPs, ERDs) with similar performance to their laboratory counterparts (stationary equipment with gel-based electrodes), while operating in a non-laboratory environment.
To assess its feasibility we carried out an experimental protocol in which 45 able bodied, right handed participants performed self-initiated reach-and-grasp actions on objects of daily life.
Each participant was recorded with a different technology:
- Mobile and dry EEG electrodes: Hero (Bitbrain)
- Mobile and semi-dry EEG electrodes: Versatile EEG (Bitbrain)
- Stationary and gel-based electrodes
We compared the results achieved with the different technologies. A brief description of the experimental protocol and results on the Hero EEG system is provided below. For a complete description of the experiment, the reader is directed to the paper (Schwarz, 2020).
1. Experiment and results
Participants were instructed to perform self-initiated reach-and-grasp actions with their right hand towards two objects: a glass (palmar grasp) and a spoon within a jar (lateral grasp). They were then asked to focus their gaze on the object to grasp for at least 2 s before starting the movement. A total of 80 trials per condition were recorded, distributed in four runs (20 trials each). The location of the objects was switched between runs.
Figure 5. Hero system during the execution of the reach-and-grasp actions. The left image shows a lateral grasp. The right image a palmar grasp. The upper right corner shows the layout of the EEG electrode placement.
We analyzed low-frequency movement-related cortical potentials (MRCPs) and event-related (de)synchronization (ERD/S) time-frequency maps using standard signal processing methods.
Figure 6. EEG correlates of movement using the Hero system for the palmar and lateral grasp actions measured in the contralateral cortex to the executing hand. (A) Grand average MRCPs (bold lines) and 95% confidence intervals (shaded areas). The black perpendicular line represents the movement onset. (B) Grand average of the time-frequency maps (one map per action), with respect to the reference period (–2 –1) s. The black vertical line represents the movement onset. Hot colors show significant ERD (i.e., power decrease with respect to the reference period). Significant differences with respect to the reference period were calculated using non-parametric t-percentile bootstrap statistics (alpha = 0.05)
Regarding the MRCPs, a negative deflection can be observed in the MRCPs waveform at movement onset that starts around 0.5 s before the movement onset. Desynchronization patterns can be observed in the time-frequency ERD/S maps, with larger values in alpha (8-12) Hz and beta (15-25) Hz frequency bands. These two patterns are in line with the literature and similar to those obtained with stationary and gel-based systems.
For a detailed comparison with other types of technologies see (Schwarz, 2020), which also shows that, using the same number and location of sensors, the decoding performance is not statistically different from widely spread and standard EEG research systems.
The dataset is publicly available. Similar results are obtained with other protocols such as a P300 experiment (Escolano, 2020).
EEG systems are the cornerstone for the effective introduction of BCIs in real-world applications outside the lab, as well as for the effective adoption in user-centered fields. In recent years, there have been strong R&D efforts in developing new EEG technologies with enhanced usability and comfort, and without sacrificing reliability and accuracy, which are opening the door to new ways of human enhancement and restoration.
- Jackson, A., & Zimmermann, J. B. (2012). Neural interfaces for the brain and spinal cord—restoring motor function. Nature Reviews Neurology, 8(12), 690–699. https://doi.org/10.1038/nrneurol.2012.219
- Johnson, W., Onuma, O., Owolabi, M., & Sachdev, S. (2016). Stroke: a global response is needed. Bulletin of the World Health Organization, 94(9), 634.
- Escolano, C., López-Larraz, E., Minguez J., & Montesano, L., (2020) Brain-computer interface-based neurorehabilitation: from the lab to the users' home, ICNR 2020.
- Pfurtscheller, G., & Da Silva, F. L. (1999). Event-related EEG/MEG synchronization and desynchronization: basic principles. Clinical neurophysiology, 110(11), 1842-1857.
- Pfurtscheller, G., Müller, G. R., Pfurtscheller, J., Gerner, H. J., & Rupp, R. (2003). ‘Thought’–control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia. Neuroscience letters, 351(1), 33-36.
- Schwarz, A., et al. (2020). Analyzing and decoding natural reach-and grasp actions using gel, water and dry eeg systems. Front Neurosci, 14, 849,
- Shibasaki, H., and Hallett, M. (2006). What is the Bereitschaftspotential? Clin. Neurophysiol. 117, 2341–2356. doi: 10.1016/j.clinph.2006.04.025
You might also be interested in
- Modern BCI-based Neurofeedback or EEG Biofeedback for Cognitive Enhancement
- Epilepsy and EEG seizure-detection
- Bringing BCIs to the user’s home for neurorehabilitation and assistive applications
- EEG Connectivity Layer and Other Features of EEG Headsets Explained
- All about EEG artifacts and filtering tools
- What is QEEG brain mapping and normative databases?
- Main features of the EEG amplifier explained
- Advances in motor neuroprosthetics improve mobility in tetraplegics
- What is neurorehabilitation and 4 leading projects in Europe
- The Use of EEG for ADHD Diagnosis and Treatment
- The Procedure and Uses of the EEG Test