Design of Cognitive Interfaces for Personal Informatics Feedback

[1]  N. Birbaumer,et al.  Conscious perception of brain states: mental strategies for brain–computer communication , 2003, Neuropsychologia.

[2]  M. Stryker,et al.  Modulation of Visual Responses by Behavioral State in Mouse Visual Cortex , 2010, Neuron.

[3]  J. Kissler,et al.  Emotion and attention in visual word processing—An ERP study , 2009, Biological Psychology.

[4]  G. Hajcak,et al.  Differentiating neural responses to emotional pictures: evidence from temporal-spatial PCA. , 2009, Psychophysiology.

[5]  D. Maurer,et al.  The shape of boubas: sound-shape correspondences in toddlers and adults. , 2006, Developmental science.

[6]  Lars Kai Hansen,et al.  The Smartphone Brain Scanner: A Portable Real-Time Neuroimaging System , 2013, PloS one.

[7]  Naoki Kawakami,et al.  Affective haptics in emotional communication , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[8]  Jodi Forlizzi,et al.  A stage-based model of personal informatics systems , 2010, CHI.

[9]  Yuichiro Kume,et al.  Vibrotactile letter reading using a low-resolution tactor array , 2004, 12th International Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2004. HAPTICS '04. Proceedings..

[10]  G. Rizzolatti,et al.  Understanding motor events: a neurophysiological study , 2004, Experimental Brain Research.

[11]  Sebastian Boring,et al.  The Streams of Our Lives: Visualizing Listening Histories in Context , 2010, IEEE Transactions on Visualization and Computer Graphics.

[12]  Jakob Eg Larsen,et al.  Emotional responses as independent components in EEG , 2014, 2014 4th International Workshop on Cognitive Information Processing (CIP).

[13]  Yacine Bellik,et al.  Multimodal interfaces: new solutions to the problem of computer accessibilty for the blind , 1994, CHI '94.

[14]  M. Junghöfer,et al.  The selective processing of briefly presented affective pictures: an ERP analysis. , 2004, Psychophysiology.

[15]  Ben J. A. Kröse,et al.  The TaSSt: Tactile sleeve for social touch , 2013, 2013 World Haptics Conference (WHC).

[16]  Paul Lemmens,et al.  A body-conforming tactile jacket to enrich movie viewing , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[17]  G. Essick,et al.  Factors affecting direction discrimination of moving tactile stimuli , 1998 .

[18]  Miltiadis K. Hatalis,et al.  Tactile display applications: a state of the art survey , 2005 .

[19]  Line Garnero,et al.  Improving quantification of functional networks with EEG inverse problem: Evidence from a decoding point of view , 2011, NeuroImage.

[20]  Hiroyuki Shinoda,et al.  Sharp tactile line presentation array using edge stimulation method , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[21]  Carl E. Sherrick,et al.  Apparent haptic movement , 1966 .

[22]  G. Rizzolatti,et al.  The functional role of the parieto-frontal mirror circuit: interpretations and misinterpretations , 2010, Nature Reviews Neuroscience.

[23]  Lars Kai Hansen,et al.  A Smartphone Interface for a Wireless EEG Headset with Real-Time 3D Reconstruction , 2011, ACII.

[24]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[25]  Jennifer Golbeck,et al.  Predicting Personality from Twitter , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[26]  T. Egner,et al.  The effects of neurofeedback training on the spectral topography of the electroencephalogram , 2004, Clinical Neurophysiology.

[27]  Daniel J Buysse,et al.  The Pittsburgh sleep quality index: A new instrument for psychiatric practice and research , 1989, Psychiatry Research.

[28]  Michael Kai Petersen,et al.  Smartphones as pocketable labs: visions for mobile brain imaging and neurofeedback. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  K. Bloch,et al.  Polysomnography: a systematic review. , 1997, Technology and health care : official journal of the European Society for Engineering and Medicine.

[30]  Koji Yatani,et al.  SemFeel: a user interface with semantic tactile feedback for mobile touch-screen devices , 2009, UIST '09.

[31]  Ondrej Krejcar,et al.  Proactive User Adaptive Application for Pleasant Wakeup , 2011, ACIIDS.

[32]  Paul T. Costa,et al.  Personality in Adulthood: A Five-Factor Theory Perspective , 2005 .

[33]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[34]  Karon E. MacLean,et al.  A first look at individuals' affective ratings of vibrations , 2013, 2013 World Haptics Conference (WHC).

[35]  Jasper Kuijsten.  Adaptive Alarm Clock Using Movement Detection to Differentiate Sleep Phases , 2010 .

[36]  S. Debener,et al.  How about taking a low-cost, small, and wireless EEG for a walk? , 2012, Psychophysiology.

[37]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[38]  Kelvin S. Oie,et al.  Cognition in action: imaging brain/body dynamics in mobile humans , 2011, Reviews in the neurosciences.

[39]  Ayca Tarhan,et al.  Pervasive Computing Technologies for Healthcare (PervasiveHealth) , 2015 .

[40]  J. Lisman,et al.  Oscillations in the alpha band (9-12 Hz) increase with memory load during retention in a short-term memory task. , 2002, Cerebral cortex.

[41]  Vera D. Khovanskaya,et al.  Reviewing reflection: on the use of reflection in interactive system design , 2014, Conference on Designing Interactive Systems.

[42]  Hartmut Heinrich,et al.  Annotation: neurofeedback - train your brain to train behaviour. , 2007, Journal of child psychology and psychiatry, and allied disciplines.

[43]  Gert Cauwenberghs,et al.  Integrated ultra-high impedance front-end for non-contact biopotential sensing , 2011, 2011 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[44]  Hideyuki Sawada,et al.  Tactile information transmission by apparent movement phenomenon using shape-memory alloy device , 2006 .

[45]  Claus-Christian Carbon,et al.  A Model for Haptic Aesthetic Processing and Its Implications for Design , 2013, Proceedings of the IEEE.

[46]  Á. Kristjánsson,et al.  Divided multimodal attention sensory trace and context coding strategies in spatially congruent auditory and visual presentation. , 2014, Multisensory research.

[47]  M. Bradley,et al.  Large-scale neural correlates of affective picture processing. , 2002, Psychophysiology.

[48]  Yoshitsugu Yasui,et al.  A brainwave signal measurement and data processing technique for daily life applications. , 2009, Journal of physiological anthropology.

[49]  Sethuraman Panchanathan,et al.  Design, Implementation, and Case Study of a Pragmatic Vibrotactile Belt , 2011, IEEE Transactions on Instrumentation and Measurement.

[50]  L. Thompson,et al.  The Neurofeedback Book: An Introduction to Basic Concepts in Applied Psychophysiology , 2003 .

[51]  Abdulmotaleb El Saddik,et al.  Spatial resolution of vibrotactile perception on the human forearm when exploiting funneling illusion , 2009, 2009 IEEE International Workshop on Haptic Audio visual Environments and Games.

[52]  Jodi Forlizzi,et al.  Understanding my data, myself: supporting self-reflection with ubicomp technologies , 2011, UbiComp '11.

[53]  M. Sheelagh T. Carpendale,et al.  Personal Visualization and Personal Visual Analytics , 2015, IEEE Transactions on Visualization and Computer Graphics.

[54]  D. P. Mandic,et al.  The In-the-Ear Recording Concept: User-Centered and Wearable Brain Monitoring , 2012, IEEE Pulse.

[55]  Hui Wang,et al.  Learning Naive Bayes Classifiers with Incomplete Data , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[56]  R. Oostenveld,et al.  Nonparametric statistical testing of EEG- and MEG-data , 2007, Journal of Neuroscience Methods.

[57]  Leonardo Bonanni,et al.  TapTap: a haptic wearable for asynchronous distributed touch therapy , 2006, CHI Extended Abstracts.

[58]  W. Klimesch.  EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[59]  Sharief F. Babiker,et al.  Tactile web navigator device for blind and visually impaired people , 2011, 2011 IEEE Jordan Conference on Applied Electrical Engineering and Computing Technologies (AEECT).

[60]  Richard M. Leahy,et al.  Electromagnetic brain mapping , 2001, IEEE Signal Process. Mag..

[61]  Erwin Schoonderwaldt,et al.  MusicJacket—Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing , 2011, IEEE Transactions on Instrumentation and Measurement.

[62]  J. Caldwell,et al.  Body posture affects electroencephalographic activity and psychomotor vigilance task performance in sleep-deprived subjects , 2003, Clinical Neurophysiology.

[63]  K.-R. Muller,et al.  The Berlin brain-computer interface: EEG-based communication without subject training , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[64]  Sara López-Martín,et al.  An electrophysiological study on the interaction between emotional content and spatial frequency of visual stimuli , 2007, Neuropsychologia.

[65]  Mohamad Eid,et al.  Aegis: A biofeedback adaptive alarm system using vibrotactile feedback , 2014, 2014 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings.

[66]  Eric Paulos,et al.  InAir: sharing indoor air quality measurements and visualizations , 2010, CHI.

[67]  F. A. Geldard.  Adventures in tactile literacy. , 1957 .

[68]  Sara C. Sereno,et al.  Early emotion word processing: Evidence from event-related potentials , 2009, Biological Psychology.

[69]  D. S. Alles,et al.  Information Transmission by Phantom Sensations , 1970 .

[70]  Jyh-Yeong Chang,et al.  Novel Dry Polymer Foam Electrodes for Long-Term EEG Measurement , 2011, IEEE Transactions on Biomedical Engineering.

[71]  G. Békésy,et al.  Funneling in the Nervous System and its Role in Loudness and Sensation Intensity on the Skin , 1958 .

[72]  Lorna M. Brown,et al.  A first investigation into the effectiveness of Tactons , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[73]  Luigi Fortuna,et al.  A resonant vibrating tactile probe for biomedical applications based on IPMC , 2009, 2009 IEEE Instrumentation and Measurement Technology Conference.

[74]  M. Codispoti,et al.  When does size not matter? Effects of stimulus size on affective modulation. , 2006, Psychophysiology.

[75]  S. Wegener,et al.  Measures of sleep: The Insomnia Severity Index, Medical Outcomes Study (MOS) Sleep Scale, Pittsburgh Sleep Diary (PSD), and Pittsburgh Sleep Quality Index (PSQI) , 2003 .

[76]  Alex Pentland,et al.  A wearable haptic navigation guidance system , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[77]  Ithabi S. Gantner,et al.  A Vibrotactile P300-Based Brain–Computer Interface for Consciousness Detection and Communication , 2014, Clinical EEG and neuroscience.

[78]  Clifford Nass,et al.  Does computer-generated speech manifest personality? an experimental test of similarity-attraction , 2000, CHI.

[79]  Arnaud Delorme,et al.  EEGLAB, SIFT, NFT, BCILAB, and ERICA: New Tools for Advanced EEG Processing , 2011, Comput. Intell. Neurosci..

[80]  S. Debener,et al.  Towards a truly mobile auditory brain-computer interface: exploring the P300 to take away. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[81]  Aribert Rothenberger,et al.  Training of slow cortical potentials in attention-deficit/hyperactivity disorder: evidence for positive behavioral and neurophysiological effects , 2004, Biological Psychiatry.

[82]  Ryan M. Traylor,et al.  A Haptic Back Display for Attentional and Directional Cueing , 2003 .

[83]  Vince D. Calhoun,et al.  Mind over chatter: Plastic up-regulation of the fMRI salience network directly after EEG neurofeedback , 2013, NeuroImage.

[84]  Paul Davidsson,et al.  Analyzing the Design Space of Personal Informatics: A State-of-practice Based Classification of Existing Tools , 2015, HCI.

[85]  C. Spence,et al.  “Bouba” and “Kiki” in Namibia? A remote culture make similar shape–sound matches, but different shape–taste matches to Westerners , 2013, Cognition.

[86]  Jeff T. Larsen,et al.  Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. , 2003, Psychophysiology.

[87]  C. Spence.  Multisensory attention and tactile information-processing , 2002, Behavioural Brain Research.

[88]  Charles Lenay,et al.  [D87] Remote tactile interaction , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[89]  Eckehard G. Steinbach,et al.  Combining Contact Models With Perceptual Data Reduction for Efficient Haptic Data Communication in Networked VEs , 2011, IEEE Transactions on Instrumentation and Measurement.

[90]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[91]  John J. Foxe,et al.  The Role of Alpha-Band Brain Oscillations as a Sensory Suppression Mechanism during Selective Attention , 2011, Front. Psychology.

[92]  F Babiloni,et al.  Linear classification of low-resolution EEG patterns produced by imagined hand movements. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[93]  Mark Hallett,et al.  Modulation of cortical activity as a result of voluntary postural sway direction: An EEG study , 2008, Neuroscience Letters.

[94]  P. Lang.  International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[95]  F. A. Geldard,et al.  The Cutaneous "Rabbit": A Perceptual Illusion , 1972, Science.

[96]  Ali Israr,et al.  Control space of apparent haptic motion , 2011, 2011 IEEE World Haptics Conference.

[97]  John Cohen.  The World of Touch , 1952, Nature.

[98]  R W Cholewiak,et al.  The generation of vibrotactile patterns on a linear array: Influences of body site, time, and presentation mode , 2000, Perception & psychophysics.

[99]  Mario Liotti,et al.  Early frontal responses elicited by physical threat words in an emotional Stroop task: Modulation by anxiety sensitivity , 2009, Biological Psychology.

[100]  Roope Raisamo,et al.  Evaluating the effect of temporal parameters for vibrotactile saltatory patterns , 2009, ICMI-MLMI '09.

[101]  A. El Saddik,et al.  EmoJacket: Consumer centric wearable affective jacket to enhance emotional immersion , 2012, 2012 International Conference on Innovations in Information Technology (IIT).

[102]  H. Noma,et al.  Vibrotactile Apparent Movement by DC Motors and Voice-coil Tactors , 2004 .

[103]  Benedikt Zoefel,et al.  Neurofeedback training of the upper alpha frequency band in EEG improves cognitive performance , 2011, NeuroImage.

[104]  Terrence J. Sejnowski,et al.  AUTOMATIC ARTIFACT REJECTION FOR EEG DATA USING HIGH-ORDER STATISTICS AND INDEPENDENT COMPONENT ANALYSIS , 2001 .

[105]  Jonathan Freeman,et al.  Touching words is not enough: How visual experience influences haptic–auditory associations in the “Bouba–Kiki” effect , 2014, Cognition.

[106]  E. Wolpert.  A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[107]  Anna M. Bianchi,et al.  Processing of Signals Recorded Through Smart Devices: Sleep-Quality Assessment , 2010, IEEE Transactions on Information Technology in Biomedicine.

[108]  Abu Saleh Md. Mahfujur Rahman,et al.  Measurements of Multimodal Approach to Haptic Interaction in Second Life Interpersonal Communication System , 2011, IEEE Transactions on Instrumentation and Measurement.

[109]  Jyh-Yeong Chang,et al.  Gaming control using a wearable and wireless EEG-based brain-computer interface device with novel dry foam-based sensors , 2012, Journal of NeuroEngineering and Rehabilitation.

[110]  Abdulmotaleb El-Saddik,et al.  Continuous tactile perception for vibrotactile displays , 2009, 2009 IEEE International Workshop on Robotic and Sensors Environments.

[111]  Sven Hoffmann,et al.  The Correction of Eye Blink Artefacts in the EEG: A Comparison of Two Prominent Methods , 2008, PloS one.

[112]  Mohamad A. Eid,et al.  SOA thresholds for the perception of discrete/continuous tactile stimulation , 2015, 2015 Seventh International Workshop on Quality of Multimedia Experience (QoMEX).

[113]  Qiang Wang,et al.  Fractal dimension based neurofeedback in serious games , 2011, The Visual Computer.

[114]  Abdulmotaleb El-Saddik,et al.  Tele-Wobble: A Telerehabilitation Wobble Board for Lower Extremity Therapy , 2012, IEEE Transactions on Instrumentation and Measurement.

[115]  T. Egner,et al.  The effect of training distinct neurofeedback protocols on aspects of cognitive performance. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[116]  Roope Raisamo,et al.  Comparison of Saltation, Amplitude Modulation, and a Hybrid Method of Vibrotactile Stimulation , 2013, IEEE Transactions on Haptics.

[117]  M. Bradley,et al.  The International Affective Picture System (IAPS) in the study of emotion and attention. , 2007 .

[118]  Jenifer Tidwell,et al.  Designing interfaces - patterns for effective interaction design , 2019 .

[119]  S. Zeki,et al.  Functional brain mapping during free viewing of natural scenes , 2004, Human brain mapping.

[120]  Jaedong Lee,et al.  Applying “out of the body” funneling and saltation to interaction with virtual and augmented objects , 2012, 2012 IEEE VR Workshop on Perceptual Illusions in Virtual Environments.

[121]  Lorena R. R. Gianotti,et al.  First Valence, Then Arousal: The Temporal Dynamics of Brain Electric Activity Evoked by Emotional Stimuli , 2008, Brain Topography.

[122]  Abdulmotaleb El-Saddik,et al.  Slingshot 3D: A synchronous haptic-audio-video game , 2012, Multimedia Tools and Applications.

[123]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[124]  Jakob Eg Larsen,et al.  QS Spiral: Visualizing Periodic Quantified Self Data , 2013 .

[125]  Sung Chan Jun,et al.  Feasibility of approaches combining sensor and source features in brain–computer interface , 2012, Journal of Neuroscience Methods.

[126]  Stephen Voida,et al.  Motivational affordances and personality types in personal informatics , 2014, UbiComp Adjunct.

[127]  L. Fadiga,et al.  Active perception: sensorimotor circuits as a cortical basis for language , 2010, Nature Reviews Neuroscience.

[128]  Lars Kai Hansen,et al.  Spatio temporal media components for neurofeedback , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[129]  M. Bradley,et al.  Emotion and the motivational brain , 2010, Biological Psychology.

[130]  Andreas Prescher,et al.  Fiber anatomy of dorsal and ventral language streams , 2013, Brain and Language.

[131]  Yu Zhao,et al.  Will you have a good sleep tonight?: sleep quality prediction with mobile phone , 2012, BODYNETS.

[132]  Ali Israr,et al.  Tactile brush: drawing on skin with a tactile grid display , 2011, CHI.

[133]  Abdulmotaleb El-Saddik,et al.  Admux: An Adaptive Multiplexer for Haptic–Audio–Visual Data Communication , 2011, IEEE Transactions on Instrumentation and Measurement.

[134]  Jacques Poitevineau,et al.  Influence of vibrotactile feedback on some perceptual features of violins. , 2014, The Journal of the Acoustical Society of America.

[135]  Wanda Pratt,et al.  Understanding quantified-selfers' practices in collecting and exploring personal data , 2014, CHI.

[136]  Hideo Mitsuhashi,et al.  Feelings of animacy and pleasantness from tactile stimulation: Effect of stimulus frequency and stimulated body part , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[137]  H. Flor,et al.  A multimodal brain-based feedback and communication system , 2004, Experimental Brain Research.

[138]  V. Ramachandran,et al.  Synaesthesia? A window into perception, thought and language , 2001 .

[139]  T Salmi,et al.  Automatic analysis of sleep records with static charge sensitive bed. , 1986, Electroencephalography and clinical neurophysiology.

[140]  A. Bonnel,et al.  Divided attention between simultaneous auditory and visual signals , 1998, Perception & psychophysics.