HMI Seminar on BCI (2009)

Description of the HMI seminar assignment:

News

Preliminary Schedule

week 6 (1)
  • Introductory Talk by Dirk Heylen: Introduction to BCI, Course Outline
  • Articles to prepare for next time:
    • (Nijholt et al., 2008)
    • and either (Mason and Birch, 2003), or (Lebedev and Nicolelis, 2006)
week 7 (2)
week 9 (3)
  • Discussion of the articles
  • Talks:
  • Hands on BCI (1) [HMI Lab]: in groups of 2, assist in current experiments as subject and experimenter (Boris, Hayrettin)
  • Articles to read: see BCI + Affect in the literature section below.
week 10 (4)
week 11 (5)
  • Presentations by 2 students + discussion (passive BCI paradigms e.g. affect, workload)
  • Talk:
    • Christian: EEGLab tutorial
  • Hands on BCI (2) [homework assignment]: look at your own EEG data
week 12 (6)
  • Presentations by 2 students + discussion (tentative topic: active BCI paradigms e.g. imaginary movement)
    • Nick: Implementation of a 3D game for developing balanced brain wave [presentation], [article]
    • Marielle: Mechanisms underlying state dependent surface-evoked response patterns [presentation], [article]
week 13 (7)
  • Presentations by 1 student + discussion (tentative topic: BCI applications)
    • Maurice: Applications of affective BCI
    • Nick: Term paper idea - discussion and feedback
week 14 (8)
  • Summary article deadline has been shifted to one week after last session
  • Presentations and discussion of summary article ideas
  • Information on potential follow-up courses: machine learning, capita selecta, HMI project, master thesis

Literature

General

Mason and Birch, A general framework for brain-computer interface design, IEEE Transactions on Neural Systems and Rehabilitation Engineering (2003).

A. Nijholt, D. Tan, G. Pfurtscheller, C. Brunner, J.R. Millán, B. Allison, B. Graimann, F. Popescu, B. Blankertz, and K.R. Müller, Brain-Computer Interfacing for Intelligent Systems, IEEE Intell. Systems, 23(3), 72–79, (2008).

M.A. Lebedev and M.A.L. Nicolelis, Brain-machine interfaces: past, present and future, Trends in Neurosciences vol 29 no 9, Elsevier (2006).

BCI Paradigms

P300

L.A. Farwell, E. Donchin, Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials, Electroencephalography and clinical Neurophysiology, Elsevier (1988).

R. Leeb, F. Lee, C. Keinrath, R. Scherer, H. Bischof, and G. Pfurtscheller, Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment, Neur. Sys. and Rehab. Eng., IEEE Trans. on, 15(4), 473–482, (2007).

ERD

Roman Krepki, Benjamin Blankertz, Gabriel Curio and Klaus-Robert Müller, The Berlin Brain-Computer Interface (BBCI) – towards a new communication channel for online control in gaming applications, Multimedia Tools and Applications, Springer (2007)

D. Oude Bos and B. Reuderink, Brainbasher: a BCI Game, in Extended Abstracts of the International Conference on Fun and Games 2008, Eindhoven, Netherlands, eds., P. Markopoulos, J. Hoonhout, I. Soute, and J. Read, pp. 36–39, Eindhoven, (October 2008). Eindhoven University of Technology.

Nijboer, F., et al., An auditory brain-computer-interface (BCI), Journal of Neuroscience Methods, 167:43--50, (2008).

SS*EP

Kelly,Lalor, Reilly, and Foxe, Visual Spatial Attention Tracking Using High-Density SSVEP Data for Independent Brain–Computer Communication, IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, VOL. 13, NO. 2, (2005)

E. C. Lalor, S. P. Kelly, C. Finucane, R. Burke, R. Smith, R. B. Reilly, and G. Mcdarby, Steady-state VEP-based brain-computer interface control in an immersive 3D gaming environment, EURASIP Journal on Applied Signal Processing, vol. 2005, no. 19, pp. 3156-3164, (2005).

Muller-Putz, G. R., et. al, Steady-state somatosensory evoked potentials: suitable brain signals for brain-computer interfaces?, IEEE Trans. Neural syst. and Rehab. Eng., Vol. 14, No.2, pp.30-37, (2006).

SCP

U. Strehl, U. Leins, G. Goth, C. Klinger, T. Hinterberger, and N. Birbaumer, Self-regulation of Slow Cortical Potentials: A New Treatment for Children With Attention-Deficit/Hyperactivity Disorder, Pediatrics, 1, 3, 9, 11 (2006).

BCI + Affect

Chanel, G., Asl, K. A., and Pun, T., Valence-arousal evaluation using physiological signals in an emotion recall paradigm, (2007).

Chanel, G., Kronegg, J., Grandjean, D., and Pun, T., Emotion assessment: Arousal evaluation using eeg’s and peripheral physiological signals, (2005).

Musha, T., Terasaki, Y., Haque, H., and Ivamitsky, G., Feature extraction from eegs associated with emotions, (1997).

BCI + Work Load

Brendan Allison and John Polich, Workload assessment of computer gaming using a single-stimulus event-related potential paradigm, (2008).

BCI Applications

A. Lecuyer, F. Lotte, R.B. Reilly, R. Leeb, M. Hirose, and M. Slater, Brain-computer interfaces, virtual reality, and videogames, Computer, 41(10), 66–72, (Oct. 2008).

B. Reuderink, Games and Brain-Computer Interfaces: The State of the Art, Internal Report, (2008).

Stephen H. Fairclough, BCI and Physiological Computing for Computer Games: Differences, Similarities & Intuitive Control, Brain-Computer Interfaces for HCI and Games, Workshop at CHI 2008, (2008).

Misc

T. Fawcett, An introduction to ROC analysis, Pattern Recognition Letters, 27(8):861{874}, (2006).

Klaus-Robert Müller, Matthias Krauledat, Guido Dornhege, Gabriel Curio, and Benjamin Blankertz, Machine learning techniques for brain-computer interfaces, Biomed Tech, 49(1):11-22, (2004)

C. Sanelli, M. Braun, M. Tangermann, and K. Mller, Estimating noise and dimensionality in bci data sets: Towards bci illiteracy comprehension, Proceedings of the 4th International Brain-Computer Interface Workshop and Training Course 2008, (2008)

Term Paper Articles

Maurice's collection

K. Gilleade, A. Dix & J. Allanson. Affective Videogames and Modes of Affective Gaming: Assist Me, Challenge Me, Emote Me. In: Proc. DIGRA'2005, 2005. download here

L Moshkina and M. Moore: Towards Affective Interfaces for Neural Signal Users. Workshop on Attitudes, Personality and Emotions in User-Adapted Interaction, in conjunction with User Adaptation and Modeling Conference, 2001. download here

Myung Hwan Yun, Joo Hwan Lee, Hyoungjoo Lee, Sungzoon Cho 2006: Classification of Bluffing Behavior and Affective Attitude from Prefrontal Surface Encephalogram During On-Line Game. ICB 2006: 706-712 10.1007/11608288

Nijholt, A. and Tan, D. (2007) Playing with your Brain: Brain-Computer Interfaces and Games. In: Proceedings ACE (International Conference on Advances in Computer Entertainment Technology) 2007, 13-15 June 2007, Salzburg, Austria. pp. 305-306 download here or download here

Nijholt, A. and van Erp, J. and Heylen, D.K.J. (2008) BrainGain: BCI for HCI and Games. In: Symposium Brain Computer Interfaces and Human Computer Interaction: A Convergence of Ideas at the AISB 2008 Convention "Communication, Interaction and Social Intelligence", 2 April 2008, Aberdeen, UK. pp. 32-35 download here

Ranganatha Sitaram, Andrea Caria, Ralf Veit, et al. (2007) , fMRI brain-computer interface: a tool for neuroscientific research and treatment, Computational Intelligence and Neuroscience Volume 7 , Issue 3 download here

Whang, Min Cheol et al. (2003) Preparing computers for affective communication: a psychophysiological concept and preliminary results Hum Factors DOI: 10.1518/hfes.45.4.623.27095

Adrien's collection

Title: Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic
Authors: Robert Leeb, Doron Friedman, Gernot R.Müller-Putz, Reinhold Scherer, Mel Slater, and Gert Pfurtscheller
DOI:10.1155/2007/79642

Title: Breaking the silence: Brain-computer interfaces (BCI) for communication and motor control
Authors: Niels Birbaumer
DOI: 10.1111/j.1469-8986.2006.00456.x

Title: Brain Computer Interface in Multimedia Communication
Authors: Touradj Ebrahimi, Jean-Marc Vesin, and Gary Garcia
DOI: 1053-5888/03/

Title: Brain-computer interface in paralysis
Authors: Niels Birbaumer, Ander Ramos Murguialday, and Leonardo Cohen
DOI: 10.1097/WCO.0b013e328315ee2d

Title: Brain-Computer Interfaces, Virtual Reality, and Videogames
Authors: Anatole Lécuyer and Fabien Lotte, Richard B. Reilly, Robert Leeb, Michitaka Hirose, Mel Slater
DOI: 0018-9162/08/

Title: Brain-Computer Interfaces for HCI and Games
Authors: Anton Nijholt, Desney Tan, Brendan Allison, José del R. Millán, Melody Moore Jackson, Bernhard Graimann
DOI: 978-1-60558-012-8/08/04.

Title: Controlling Robots with the Mind
Authors: ScientificAmerican.com
September 16, 2002

Title: Medicine and society: Ethical and social challenges of brain-computer interfaces
Authors: Virtual Mentor
American Medical Association Journal of Ethics
February 2007, Volume 9, Number 2: 128-131.

Title: Nessi: An EEG-ControlledWeb Browser for Severely Paralyzed Patients
Authors: Michael Bensch, Ahmed A. Karim, Jürgen Mellinger, Thilo Hinterberger, Michael Tangermann, Martin Bogdan, Wolfgang Rosenstiel, and Niels Birbaumer
DOI: 10.1155/2007/71863

Title: Brain Computer Interfaces: Psychology and Pragmatic Perspectives for the Future
Authors: Ray Adams, Gisela Susanne Bahr and Benigno Moreno

Title: Human Performance (Pentagon Report)
Authors: JASON - The MITRE Corporation

Nick's collection

1. Nijholt, A. and T. Desney(2008),
"Brain Computer Interfacing for Intelligent Systems.", University of Twente: IEEE Computer Society

2. M. A. Lebedev and M.A.L.Nicolelis(2008),
"Brain-machine interfaces: past,present and future. TRENDS in Neurosciences Vol 29 No. 9, Elsevier.

3. S.G. Mason and G.E.Birch(2008),
"A General Framework for Brain-Computer Interface Design"

4. A.Kubler, K.R. Muller(2007),
"An Introduction te Brain-Computer-Interfacing", Berlin

5. J.R.Wolpaw, N. Birbaumer, D.J.McFarland, G.Pfurtscheller, T.M.Vaughan(2002),
"Brain-computer interfaces or communication and control", Clinical Neurophysiology 113 767-791, Elsevier.

6. E.Jovanov, A.Milenkovic, C.Otto, P.C. de Groen(2005),
"A wireless body area network of intelligent motion sensors for computer assisted physical rehabilitation", Journal of NeuroEngineering and Rehabilitation 2005 2:6.

7. A.Nijholt, D.Tan
"Playing with Your Brain: Brain-Computer Interfaces and Games"

8. B.Shim, S.L and J.Shin (2007),
"Implementation of a 3-Dimensional Game for developing balanced Brain-wave", IEEE, Catholic University of Daegu, Korea

9. A.Nijholt, D.Tan(2008),
"Brain-Computer Interfacing for Intelligent Systems", IEEE 1541-1672/08, University of Twente, Enschede

10. R.Krepki, B.Blankertz, G.Curio, K.Müller(2007),
"The Berlin Brain-Computer Interface(BBCI) - towards a new communication channel for online control in gaming applications", Springer Science + Business Media, LLC 2007.

11. J. van Aart, E.Klaver, C.Bartneck, L.Feijs, P.Peters,
"Neurofeedback Gaming for Wellbeing", Department of Industriel Design, Eindhoven, the Netherlands

12. B.Allison, B.Graimann, A. Gräser,
"Why Use a BCI If You Are Healthy", University of Bremen, Germany

13. B.Blankertz, M.Krauledat, G.Dornhege, J.Williamson, R.Smith, K.Müller,
"Advanced Human-Computer Interaction with the Berlin Brain Computer Interface"

14. S.H.Fairclough,
"Psychophysiological Inference and Physiological Computer Games", Liverpool, UK.

15. B.Graimann, B.Allison, A.Gräser,
"New Applications for Non-invasive Brain-Computer Interfaces and the Need for Engaging Training Environments", University of Bremen, Germany

16. C. Gucer, G. Edlinger,
"How many people can control a brain-computer interface(BCI).

17. K.Kuikkaniemi, I.Kosunen,
"Progressive System Architecture for Building Emotionally Adaptive Games"

18. R.Scherer, F.Lee,A.Schlögl, R.Leeb, H.Bischof, G.Pfurtscheller,
"EEG-based interaction with virtual worlds: A self-paces three class Brain-Computer Interface"

19. P.J.Werkhoven, J.B.F. van Erp,
"Serious gaming requires serious interfaces"

Michel's collection

Michel's paper collection