Online transcranial Doppler ultrasonographic control of an onscreen keyboard

Brain-computer interface (BCI) systems exploit brain activity for generating a control command and may be used by individuals with severe motor disabilities as an alternative means of communication. An emerging brain monitoring modality for BCI development is transcranial Doppler ultrasonography (TCD), which facilitates the tracking of cerebral blood flow velocities associated with mental tasks. However, TCD-BCI studies to date have exclusively been offline. The feasibility of a TCD-based BCI system hinges on its online performance. In this paper, an online TCD-BCI system was implemented, bilaterally tracking blood flow velocities in the middle cerebral arteries for system-paced control of a scanning keyboard. Target letters or words were selected by repetitively rehearsing the spelling while imagining the writing of the intended word, a left-lateralized task. Undesired letters or words were bypassed by performing visual tracking, a non-lateralized task. The keyboard scanning period was 15 s. With 10 able-bodied right-handed young adults, the two mental tasks were differentiated online using a Naïve Bayes classification algorithm and a set of time-domain, user-dependent features. The system achieved an average specificity and sensitivity of 81.44 ± 8.35 and 82.30 ± 7.39%, respectively. The level of agreement between the intended and machine-predicted selections was moderate (κ = 0.60). The average information transfer rate was 0.87 bits/min with an average throughput of 0.31 ± 0.12 character/min. These findings suggest that an online TCD-BCI can achieve reasonable accuracies with an intuitive language task, but with modest throughput. Future interface and signal classification enhancements are required to improve communication rate.

[1]  Dorothy V M Bishop,et al.  Reliability of a novel paradigm for determining hemispheric lateralization of visuospatial function , 2009, Journal of the International Neuropsychological Society.

[2]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[3]  S. Millar.  Augmentative Communication in Practice , 1998 .

[4]  José del R. Millán,et al.  Evaluation Criteria for BCI Research , 2007 .

[5]  A. Kamondi,et al.  Correlation between blood flow velocity in the middle cerebral artery and EEG during cognitive effort. , 2005, Brain research. Cognitive brain research.

[6]  D. Newell.  Transcranial Doppler ultrasonography. , 1994, Neurosurgery clinics of North America.

[7]  Tom Chau,et al.  A Review of Emerging Access Technologies for Individuals With Severe Motor Impairments , 2008, Assistive technology : the official journal of RESNA.

[8]  Tom Chau,et al.  A Brain-Computer Interface Based on Bilateral Transcranial Doppler Ultrasound , 2011, PloS one.

[9]  Ludovico Minati,et al.  Thoughts turned into high-level commands: Proof-of-concept study of a vision-guided robot arm driven by functional MRI (fMRI) signals. , 2012, Medical engineering & physics.

[10]  Andrew Collier,et al.  Role of transcranial Doppler ultrasonography in stroke , 2007, Postgraduate Medical Journal.

[11]  A. Alexandrov,et al.  Advances in transcranial doppler ultrasonography , 2009, Current neurology and neuroscience reports.

[12]  Achim Weigel,et al.  Normalizing the weighted edit distance , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[13]  Jacob Cohen.  A Coefficient of Agreement for Nominal Scales , 1960 .

[14]  Yael Arbel,et al.  P300 Based Brain Computer Interfaces: A Progress Report , 2009, HCI.

[15]  A. Schlögl,et al.  Interrater reliability between scorers from eight European sleep laboratories in subjects with different sleep disorders , 2004, Journal of sleep research.

[16]  T. Falk,et al.  Taking NIRS-BCIs Outside the Lab: Towards Achieving Robustness Against Environment Noise , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  H. White,et al.  Applications of transcranial Doppler in the ICU: a review , 2006, Intensive Care Medicine.

[18]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[19]  M. Hollander,et al.  Statistics: A Biomedical Introduction. , 1977 .

[20]  Enrique Vidal,et al.  Computation of Normalized Edit Distance and Applications , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  H. Flor,et al.  A spelling device for the paralysed , 1999, Nature.

[22]  K. A. Mamun,et al.  A robust strategy for decoding movements from deep brain local field potentials to facilitate brain machine interfaces , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[23]  Susanne Knake,et al.  Language lateralization in children using functional transcranial Doppler sonography , 2010, Developmental medicine and child neurology.

[24]  Li Yujian,et al.  A Normalized Levenshtein Distance Metric , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  David Sankoff,et al.  Time Warps, String Edits, and Macromolecules: The Theory and Practice of Sequence Comparison , 1983 .

[26]  A. Schlögl,et al.  An E-Health Solution for Automatic Sleep Classification according to Rechtschaffen and Kales: Validation Study of the Somnolyzer 24 × 7 Utilizing the Siesta Database , 2005, Neuropsychobiology.

[27]  G. Vingerhoets,et al.  Lateralization of cerebral blood flow velocity changes during cognitive tasks. A simultaneous bilateral transcranial Doppler study. , 1999, Stroke.

[28]  S. Millar.  Augmentative Communication in Practice: an Introduction , 1998 .

[29]  R. Aaslid,et al.  Visually evoked dynamic blood flow response of the human cerebral circulation. , 1987, Stroke.

[30]  T. Chau,et al.  Towards increased data transmission rate for a three-class metabolic brain–computer interface based on transcranial Doppler ultrasound , 2012, Neuroscience Letters.

[31]  Gregory W. Lesher,et al.  Techniques for augmenting scanning communication , 1998 .

[32]  Research in the area of voluntary immunomodulation: complexities, consistencies and future research considerations. , 1989, The International journal of neuroscience.

[33]  Guy Vingerhoets,et al.  Transcranial Doppler Ultrasonography Monitoring of Cerebral Hemodynamics During Performance of Cognitive Tasks: A Review , 2000, Neuropsychology Review.

[34]  H. Zetterberg,et al.  Transcranial Doppler microembolic signals and serum marker evidence of brain injury during transcatheter aortic valve implantation , 2012, Acta anaesthesiologica Scandinavica.

[35]  R. Aaslid,et al.  Noninvasive transcranial Doppler ultrasound recording of flow velocity in basal cerebral arteries. , 1982, Journal of neurosurgery.

[36]  Xiaoping P. Hu,et al.  Real‐time fMRI using brain‐state classification , 2007, Human brain mapping.

[37]  R. Buxton,et al.  A Model for the Coupling between Cerebral Blood Flow and Oxygen Metabolism during Neural Stimulation , 1997, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[38]  Tony Scott,et al.  Analysis of performance , 2005 .

[39]  Niels Birbaumer,et al.  Hemodynamic brain-computer interfaces for communication and rehabilitation , 2009, Neural Networks.

[40]  David G. Stork,et al.  Pattern Classification , 1973 .

[41]  Tom Chau,et al.  Towards a hemodynamic BCI using transcranial Doppler without user-specific training data. , 2013, Journal of neural engineering.

[42]  Maureen Clerc,et al.  An analysis of performance evaluation for motor-imagery based BCI , 2013, Journal of neural engineering.

[43]  Soo-Young Lee,et al.  Brain–computer interface using fMRI: spatial navigation by thoughts , 2004, Neuroreport.

[44]  Tom Chau,et al.  Towards a multimodal brain–computer interface: Combining fNIRS and fTCD measurements to enable higher classification accuracy , 2013, NeuroImage.

[45]  Surrey Sm,et al.  Guidelines for the Safe use of Diagnostic Ultrasound Equipment , 2000 .

[46]  L. Wechsler,et al.  Transcranial doppler ultrasonography , 1999 .

[47]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[48]  C. Neuper,et al.  The effect of distinct mental strategies on classification performance for brain-computer interfaces. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[49]  A G Harders,et al.  Brain activity and blood flow velocity changes: a transcranial Doppler study. , 1989, The International journal of neuroscience.

[50]  Manfred Kaps,et al.  Practice Standards for Transcranial Doppler Ultrasound: Part I—Test Performance , 2007, Journal of neuroimaging : official journal of the American Society of Neuroimaging.

[51]  Kouji Takano,et al.  My thoughts through a robot's eyes: An augmented reality-brain–machine interface , 2010, Neuroscience Research.