Conducting performance evaluation of an e-Health platform.

For increased awareness and adoption of e-Health implementations, results from evaluation must be catered towards three primary perspectives: organizational, end-user and technical perspective. This chapter addresses the issue of conducting performance evaluation of e-Health for the technical perspective. The authors present the design of metrics that enable them to evaluate the scalability, functionality and reliability of e-Health implementations. Using simulated patient data, experiments are conducted on an existing e-Health platform using their defined metrics. Results show that 100 simulated patient’s data may interact with the e-Health platform under evaluation with a maximum round-trip time latency value of 6.6 seconds. By building upon the techniques the authors have used to conduct performance evaluation of e-Health implementations, along with the design of methodologies to enable evaluation to take place for the two other perspectives, i.e. end-user and organizational perspectives, the authors hope to see greater support for this technology in the near future.

[1]  Yan Han,et al.  On the Clouds: A New Way of Computing , 2010 .

[2]  E. Vance Wilson,et al.  Current Trends in Patients' Adoption of Advanced E-Health Services , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[3]  Elske Ammenwerth,et al.  Evaluation of health information systems - problems and challenges , 2003, Int. J. Medical Informatics.

[4]  Daniel Slamanig,et al.  Privacy Aspects of eHealth , 2008, 2008 Third International Conference on Availability, Reliability and Security.

[5]  A. Jadad,et al.  What Is eHealth (3): A Systematic Review of Published Definitions , 2005, Journal of medical Internet research.

[6]  R. Paterson,et al.  Prediction of in-hospital mortality and length of stay using an early warning scoring system: clinical audit. , 2006, Clinical medicine.

[7]  Benjamin Kuipers,et al.  Qualitative and Quantitative Simulation: Bridging the Gap , 1997, Artif. Intell..

[8]  Guy Fitzgerald,et al.  Identification of benefits and barriers for the adoption of e-health information systems using a socio-technical approach , 2008, ITI 2008 - 30th International Conference on Information Technology Interfaces.

[9]  David B Abrams,et al.  Critical issues in eHealth research. , 2007, American journal of preventive medicine.

[10]  P. Mackowiak,et al.  A critical appraisal of 98.6 degrees F, the upper limit of the normal body temperature, and other legacies of Carl Reinhold August Wunderlich. , 1992, JAMA.

[11]  M. Pringle,et al.  Evaluating eHealth: How to Make Evaluation More Methodologically Robust , 2009, PLoS medicine.

[12]  C. Chatfield,et al.  Statistics for physicists , 1971 .

[13]  C. Subbe,et al.  Validation of a modified Early Warning Score in medical admissions. , 2001, QJM : monthly journal of the Association of Physicians.

[14]  Jorge Werner,et al.  A Cloud Computing Solution for Patient's Data Collection in Health Care Institutions , 2010, 2010 Second International Conference on eHealth, Telemedicine, and Social Medicine.

[15]  J Henderson,et al.  Developers and evaluation of interactive health communication applications. The Science Panel on Interactive Communications and Health. , 1999, American journal of preventive medicine.

[16]  J. Grogan,et al.  EHRs and information availability: are you at risk? , 2006, Health management technology.

[17]  John W. Hill,et al.  The national healthcare crisis: Is eHealth a key solution? , 2009 .

[18]  Ling Liu,et al.  Security Models and Requirements for Healthcare Application Clouds , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[19]  F. Mair,et al.  Factors that promote or inhibit the implementation of e-health systems: an explanatory systematic review. , 2012, Bulletin of the World Health Organization.

[20]  Terrence D. Perera,et al.  Automated data collection for simulation? , 2002, Simul. Pract. Theory.

[21]  Justyna Matysiewicz,et al.  Consumer Trust - Challenge for E-healthcare , 2009, 2009 Fourth International Conference on Cooperation and Promotion of Information Resources in Science and Technology.

[22]  E. Lacey,et al.  Tapping patient satisfaction: a strategy for quality assessment. , 1988, Patient education and counseling.

[23]  Nathan K. Cobb,et al.  Initial evaluation of a real-world Internet smoking cessation system. , 2005, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[24]  B Lin,et al.  Methodological issues in patient satisfaction surveys. , 1995, International journal of health care quality assurance.

[25]  Noboru Sonehara,et al.  Aspects of privacy for electronic health records , 2011, Int. J. Medical Informatics.

[26]  B. Williams.  Patient satisfaction: a valid concept? , 1994, Social science & medicine.

[27]  Pierangelo Garino,et al.  Key concepts for the Future Internet architecture , 2011, 2011 Future Network & Mobile Summit.

[28]  Lyudmila Mihaylova,et al.  Quality of Service Consideration for the Wireless Telemedicine and E-Health Services , 2009, 2009 IEEE Wireless Communications and Networking Conference.

[29]  Nicholas R. Hardiker,et al.  Factors that influence public engagement with eHealth: A literature review , 2011, Int. J. Medical Informatics.

[30]  Chien-Tsai Liu,et al.  Assessment of user satisfaction with an Internet-based integrated patient education system for diabetes management , 2008, HealthCom 2008 - 10th International Conference on e-health Networking, Applications and Services.

[31]  Hsin-Lu Chang,et al.  Assessing the Performance of e-Health Service , 2011, 2011 International Joint Conference on Service Sciences.

[32]  G R Pesola,et al.  The normal difference in bilateral indirect blood pressure recordings in normotensive individuals. , 2001, The American journal of emergency medicine.

[33]  Russell E Glasgow,et al.  eHealth evaluation and dissemination research. , 2007, American journal of preventive medicine.

[34]  David J. Brailer,et al.  Economic Perspectives on Health Information Technology , 2005 .

[35]  Fahim Sufi,et al.  A mobile phone based intelligent scoring approach for assessment of critical illness , 2008, 2008 International Conference on Information Technology and Applications in Biomedicine.

[36]  Osman Balci.  Principles and techniques of simulation validation, verification, and testing , 1995, WSC '95.

[37]  Peggy Gregory,et al.  Expectations and experiences of eHealth in primary care: A qualitative practice-based investigation , 2009, Int. J. Medical Informatics.

[38]  S Holm,et al.  Ethical aspects of clinical trials: the attitudes of the public and out‐patients , 1999, Journal of internal medicine.

[39]  Vincenzo Della Mea,et al.  What is e-Health (2): The death of telemedicine? , 2001, Journal of medical Internet research.

[40]  A. Donabedian,et al.  The quality of care. How can it be assessed? , 1988, JAMA.

[41]  A. Sheikh,et al.  Evaluating eHealth Interventions: The Need for Continuous Systemic Evaluation , 2009, PLoS medicine.

[42]  Vincenzo Della Mea,et al.  What is e-Health (2): The death of telemedicine? , 2001 .

[43]  L. White,et al.  A critical review of patient satisfaction , 2009 .

[44]  Elias Ekonomou,et al.  SPoC: Protecting Patient Privacy for e-Health Services in the Cloud , 2012, eTELEMED 2012.

[45]  Sebastian Garde,et al.  Health Informatics: An Overview , 2010 .

[46]  Stanley B. Zdonik,et al.  “Data in your face”: push technology in perspective , 1998, SIGMOD '98.

[47]  J. Banks,et al.  Discrete-Event System Simulation , 1995 .

[48]  Claudia Pagliari,et al.  Design and Evaluation in eHealth: Challenges and Implications for an Interdisciplinary Field , 2007, Journal of medical Internet research.

[49]  Chris Rose,et al.  A Break in the Clouds: Towards a Cloud Definition , 2011 .

[50]  Koushik Maharatna,et al.  A low-power simplified-MEWS scoring device for patient monitoring , 2010, 2010 4th International Conference on Pervasive Computing Technologies for Healthcare.

[51]  Vladimir Stantchev,et al.  Performance Evaluation of Cloud Computing Offerings , 2009, 2009 Third International Conference on Advanced Engineering Computing and Applications in Sciences.

[52]  Kallirroi Georgila,et al.  Quantitative Evaluation of User Simulation Techniques for Spoken Dialogue Systems , 2005, SIGDIAL.

[53]  Patricia Biller Krauskopf,et al.  E-health and Nursing: Using Smartphones to Enhance Nursing Practice , 2012 .

[54]  Elias Ekonomou,et al.  E-Health: Chances and Challenges of Distributed, Service oriented Architectures , 2012, J. Cyber Secur. Mobil..

[55]  Debbe Thompson,et al.  A framework for evaluating eHealth research. , 2006, Evaluation and program planning.

[56]  C. May,et al.  Implementing, Embedding, and Integrating Practices: An Outline of Normalization Process Theory , 2009 .

[57]  B. O'driscoll,et al.  BTS guideline for emergency oxygen use in adult patients , 2008, Thorax.

[58]  K Dave,et al.  A CRITICAL APPRAISAL , 2002 .

[59]  A Hasman,et al.  A systematic view on medical informatics. , 1996, Computer methods and programs in biomedicine.

[60]  Charles R Meyer,et al.  A web-based interface for communication of data between the clinical and research environments without revealing identifying information. , 2007, Academic radiology.

[61]  William J. Buchanan,et al.  An Integrated Cloud-based Healthcare Infrastructure , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[62]  Reinhold Haux,et al.  Medical informatics: Past, present, future , 2010, Int. J. Medical Informatics.

[63]  J. Garcia,et al.  Performance Evaluation of Rural e-Health Scenarios: Users and QoS Management , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[64]  F. Giorgio,et al.  European eHealth Governance Initiative: A New Way Forward , 2013 .

[65]  T. Weisner,et al.  Mixing qualitative and quantitative research in developmental science: uses and methodological choices. , 2008, Developmental psychology.

[66]  D. Hudson.,et al.  Statistics for Physicists , 1972 .

[67]  L. Shoemaker Allen,et al.  What's Normal? – Temperature, Gender, and Heart Rate , 1996 .

[68]  G. Eysenbach.  What is e-health? , 2001, Journal of Medical Internet Research.

[69]  Ricardo Araya,et al.  Therapist-delivered internet psychotherapy for depression in primary care: a randomised controlled trial , 2009, The Lancet.

[70]  Andis Robeznieks.  Privacy fear factor arises. The public sees benefits to be had from healthcare IT but concerns about misuse of data emerge in survey. , 2005, Modern healthcare.

[71]  Kaija Saranto,et al.  Definition, structure, content, use and impacts of electronic health records: A review of the research literature , 2008, Int. J. Medical Informatics.

[72]  William J. Buchanan,et al.  DACAR Platform for eHealth Services Cloud , 2011, 2011 IEEE 4th International Conference on Cloud Computing.