Augmented reality for personalized nanomedicines.

As our understanding of onset and progress of diseases at the genetic and molecular level rapidly progresses, the potential of advanced technologies, such as 3D-printing, Socially-Assistive Robots (SARs) or augmented reality (AR), that are applied to personalized nanomedicines (PNMs) to alleviate pathological conditions, has become more prominent. Among advanced technologies, AR in particular has the greatest potential to address those challenges and facilitate the translation of PNMs into formidable clinical application of personalized therapy. As AR is about to adapt additional new methods, such as speech, voice recognition, eye tracing and motion tracking, to enable interaction with host response or biological systems in 3-D space, a combination of multiple approaches to accommodate varying environmental conditions, such as public noise and atmosphere brightness, will be explored to improve its therapeutic outcomes in clinical applications. For instance, AR glasses still being developed by Facebook or Microsoft will serve as new platform that can provide people with the health information they are interested in or various measures through which they can interact with medical services. This review has addressed the current progress and impact of AR on PNMs and its application to the biomedical field. Special emphasis is placed on the application of AR based PNMs to the treatment strategies against senior care, drug addiction and medication adherence.

[1]  S. Yoo,et al.  Creating perfused functional vascular channels using 3D bio-printing technology. , 2014, Biomaterials.

[2]  Anthony Atala,et al.  3D bioprinting of tissues and organs , 2014, Nature Biotechnology.

[3]  Cynthia Breazeal,et al.  The Design of the Huggable: A Therapeutic Robotic Companion for Relational, Affective Touch , 2006, AAAI Fall Symposium: Caring Machines.

[4]  A. Shuldiner,et al.  Pharmacometabolomics Reveals That Serotonin Is Implicated in Aspirin Response Variability , 2014, CPT: pharmacometrics & systems pharmacology.

[5]  R. Bell,et al.  The use of 3D imaging tools in facial plastic surgery. , 2011, Facial plastic surgery clinics of North America.

[6]  R. Drake,et al.  Dual diagnosis: 15 years of progress. , 2000, Psychiatric services.

[7]  Surgeons see future applications for Google Glass. , 2014, Bulletin of the American College of Surgeons.

[8]  Randall M. Erb,et al.  Designing bioinspired composite reinforcement architectures via 3D magnetic printing , 2015, Nature Communications.

[9]  N. Petry,et al.  Motivational incentives research in the National Drug Abuse Treatment Clinical Trials Network. , 2010, Journal of substance abuse treatment.

[10]  C. Newgard,et al.  Integrated metabolomics and genomics: systems approaches to biomarkers and mechanisms of cardiovascular disease. , 2015, Circulation. Cardiovascular genetics.

[11]  Chi H. Lee,et al.  Development of Thiolated-Graphene Quantum Dots for Regulation of ROS in macrophages , 2016, Pharmaceutical Research.

[12]  E. Garland,et al.  Mindfulness Training Targets Neurocognitive Mechanisms of Addiction at the Attention-Appraisal-Emotion Interface , 2014, Front. Psychiatry.

[13]  D. Black,et al.  Mindfulness-Based Interventions: An Antidote to Suffering in the Context of Substance Use, Misuse, and Addiction , 2014, Substance use & misuse.

[14]  Anthony Atala,et al.  Printing Technologies for Medical Applications. , 2016, Trends in molecular medicine.

[15]  L. Hartwell,et al.  Integrating genetic approaches into the discovery of anticancer drugs. , 1997, Science.

[16]  Wendy A. Rogers,et al.  Older adults' medication management in the home: How can robots help? , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[17]  Francisco J. Ruiz,et al.  A review of Acceptance and Commitment Therapy (ACT) empirical evidence: Correlational, experimental psychopathology, component and outcome studies. , 2010 .

[18]  Robert L. Tanguay,et al.  In vivo biodistribution and toxicity depends on nanomaterial composition, size, surface functionalisation and route of exposure , 2008 .

[19]  Shigeki Sugano,et al.  Design of human symbiotic robot TWENDY-ONE , 2009, 2009 IEEE International Conference on Robotics and Automation.

[20]  Susanne Iwarsson,et al.  Aging well and the environment: toward an integrative model and research agenda for the future. , 2012, The Gerontologist.

[21]  Maurice Y Nahabedian,et al.  Google Glass in the Operating Room: The Plastic Surgeon's Perspective. , 2016, Plastic and reconstructive surgery.

[22]  Ara Darzi,et al.  Image guidance for all--TilePro display of 3-dimensionally reconstructed images in robotic partial nephrectomy. , 2014, Urology.

[23]  David W Bates,et al.  Pharmacists belong in accountable care organizations and integrated care teams. , 2013, Health affairs.

[24]  Gen Endo,et al.  Mobile follower robot as an assistive device for home oxygen therapy – evaluation of tether control algorithms , 2015 .

[25]  Paolo Dario,et al.  Enabling personalised medical support for chronic disease management through a hybrid robot-cloud approach , 2017, Auton. Robots.

[26]  J. Marescaux,et al.  Augmented reality in laparoscopic surgical oncology. , 2011, Surgical oncology.

[27]  A. di Cerbo,et al.  Narrative review of telemedicine consultation in medical practice , 2015, Patient preference and adherence.

[28]  Ying Mei,et al.  3D Bioprinting for Vascularized Tissue Fabrication , 2016, Annals of Biomedical Engineering.

[29]  Fabian Kiessling,et al.  Recent progress in nanomedicine: therapeutic, diagnostic and theranostic applications. , 2013, Current opinion in biotechnology.

[30]  S. Nijman Synthetic lethality: General principles, utility and detection using genetic screens in human cells , 2011, FEBS letters.

[31]  Bruce A. MacDonald,et al.  Feasibility Study of a Robotic Medication Assistant for the Elderly , 2011, AUIC.

[32]  A. Rosenblum,et al.  Factors associated with medication adherence among psychiatric outpatients at substance abuse risk. , 2011, The open addiction journal.

[33]  John P. Overington,et al.  An atlas of genetic influences on human blood metabolites , 2014, Nature Genetics.

[34]  Bruce A. MacDonald,et al.  End User Programming to Enable Closed-loop Medication Management Using a Healthcare Robot , 2011 .

[35]  Seung-Schik Yoo,et al.  Generation of Multi-scale Vascular Network System Within 3D Hydrogel Using 3D Bio-printing Technology , 2014, Cellular and molecular bioengineering.

[36]  Samuel Achilefu,et al.  Hands-free, wireless goggles for near-infrared fluorescence and real-time image-guided surgery. , 2011, Surgery.

[37]  Tadele Eticha,et al.  Factors Associated with Medication Adherence among Patients with Schizophrenia in Mekelle, Northern Ethiopia , 2015, PloS one.

[38]  F. Steemers,et al.  Screening unlabeled DNA targets with randomly ordered fiber-optic gene arrays , 2000, Nature Biotechnology.

[39]  Ronald W. Davis,et al.  Quantitative Monitoring of Gene Expression Patterns with a Complementary DNA Microarray , 1995, Science.

[40]  Frederick P. Brooks What's Real About Virtual Reality? , 1999, IEEE Computer Graphics and Applications.

[41]  Donna K Slonim,et al.  Synthetic lethal analysis of Caenorhabditis elegans posterior embryonic patterning genes identifies conserved genetic interactions , 2005, Genome Biology.

[42]  S. Gambhir,et al.  Molecular imaging in living subjects: seeing fundamental biological processes in a new light. , 2003, Genes & development.

[43]  David Goldman,et al.  HTR3B is associated with alcoholism with antisocial behavior and alpha EEG power--an intermediate phenotype for alcoholism and co-morbid behaviors. , 2009, Alcohol.

[44]  K. Scearce-Levie,et al.  A Therapeutic Antibody Targeting BACE1 Inhibits Amyloid-β Production in Vivo , 2011, Science Translational Medicine.

[45]  O. Fiehn,et al.  Pharmacometabolomics of Response to Sertraline and to Placebo in Major Depressive Disorder – Possible Role for Methoxyindole Pathway , 2013, PloS one.

[46]  Oliver Brock,et al.  A novel type of compliant and underactuated robotic hand for dexterous grasping , 2016, Int. J. Robotics Res..

[47]  Peter Sincak,et al.  Emergent Trends in Robotics and Intelligent Systems , 2015 .

[48]  R. Hubbard,et al.  Drug Abuse Treatment and Comprehensive Services for Adolescents , 2001 .

[49]  R B Haynes,et al.  Interventions for enhancing medication adherence. , 2008, The Cochrane database of systematic reviews.

[50]  Richard B. Fair,et al.  Digital microfluidics: is a true lab-on-a-chip possible? , 2007 .

[51]  Muna S. Al-Razgan,et al.  Systematic Review of Robotics Use Since 2005 , 2016 .

[52]  Xue-Qing Zhang,et al.  Interactions of nanomaterials and biological systems: Implications to personalized nanomedicine. , 2012, Advanced drug delivery reviews.

[53]  Juyang Weng,et al.  The architecture and body of FUWA developmental humanoid , 2008, 2008 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[54]  Chi H. Lee,et al.  Biomimicking Robust Hydrogel for the Mesenchymal Stem Cell Carrier , 2015, Pharmaceutical Research.

[55]  Shuichi Nishio,et al.  Cloud networked robotics , 2012, IEEE Network.

[56]  R. Krauss,et al.  Pharmacometabolomics of Statin Response , 2013, Clinical pharmacology and therapeutics.

[57]  D. Wishart Emerging applications of metabolomics in drug discovery and precision medicine , 2016, Nature Reviews Drug Discovery.

[58]  A.-S. Rigaud,et al.  CompanionAble: Graceful integration of mobile robot companion with a smart home environment , 2009 .

[59]  Ronald Azuma,et al.  Recent Advances in Augmented Reality , 2001, IEEE Computer Graphics and Applications.

[60]  Chee Kai Chua,et al.  Bioprinting: Principles and Applications , 2015 .

[61]  S. Xiao,et al.  From Abstinence to Relapse: A Preliminary Qualitative Study of Drug Users in a Compulsory Drug Rehabilitation Center in Changsha, China , 2015, PloS one.

[62]  B. Carter,et al.  Meta-analysis of cue-reactivity in addiction research. , 1999, Addiction.

[63]  O. Fiehn,et al.  Purine Pathway Implicated in Mechanism of Resistance to Aspirin Therapy: Pharmacometabolomics-Informed-Pharmacogenomics , 2013, Clinical pharmacology and therapeutics.

[64]  Eytan Ruppin,et al.  Synthetic dosage lethality in the human metabolic network is highly predictive of tumor growth and cancer patient survival , 2015, Proceedings of the National Academy of Sciences.

[65]  W. R. Wikoff,et al.  Pharmacometabolomics Reveals Racial Differences in Response to Atenolol Treatment , 2013, PloS one.

[66]  Eytan Ruppin,et al.  Predicting Cancer-Specific Vulnerability via Data-Driven Detection of Synthetic Lethality , 2014, Cell.

[67]  Shagun B. Shah,et al.  Venous Thromboembolism and Robotic Surgery: Need for Prophylaxis and Review of Literature , 2015 .

[68]  Florence T. Bourgeois,et al.  Postmarketing Trials and Pediatric Device Approvals , 2014, Pediatrics.

[69]  Chi H. Lee,et al.  Stimuli-sensitive nanoparticles for multiple anti-HIV microbicides , 2016, Journal of Nanoparticle Research.

[70]  Robert Riener,et al.  Robot-aided assessment of lower extremity functions: a review , 2016, Journal of NeuroEngineering and Rehabilitation.

[71]  Francesca Joseph,et al.  FDA’s Pediatric Device Consortia: National Program Fosters Pediatric Medical Device Development , 2013, Pediatrics.

[72]  A. Darzi,et al.  Augmented reality partial nephrectomy: examining the current status and future perspectives. , 2014, Urology.

[73]  U. Demirci,et al.  Bioprinting for stem cell research. , 2013, Trends in biotechnology.

[74]  Sang Do Noh,et al.  Virtual reality applications in manufacturing industries: Past research, present findings, and future directions , 2015, Concurr. Eng. Res. Appl..

[75]  J. Schaler Addiction Beliefs of Treatment Providers: Factors Explaining Variance , 1997 .

[76]  Ken Doyle,et al.  Bioprinting: From Patches to Parts , 2014 .

[77]  L. Partridge,et al.  Science fact and the SENS agenda , 2005 .

[78]  M. McGurk,et al.  Augmented reality visualization in head and neck surgery: an overview of recent findings in sentinel node biopsy and future perspectives. , 2016, The British journal of oral & maxillofacial surgery.

[79]  M. Foiani,et al.  A lethal combination for cancer cells: synthetic lethality screenings for drug discovery. , 2010, European journal of cancer.

[80]  Ulrich Neumann,et al.  Dynamic registration correction in augmented-reality systems , 1995, Proceedings Virtual Reality Annual International Symposium '95.

[81]  Zhiwei Luo,et al.  Development of the Tactile Sensor System of a Human-Interactive Robot “RI-MAN” , 2008, IEEE Transactions on Robotics.

[82]  F. Kiessling,et al.  The theranostic path to personalized nanomedicine , 2014, Clinical and translational imaging.

[83]  R. Haynes,et al.  Interventions for enhancing medication adherence. , 2008, The Cochrane database of systematic reviews.

[84]  Socializing a Social Robot with an Artificial Society , 2013 .

[85]  Chi H. Lee,et al.  Development of Man-rGO for Targeted Eradication of Macrophage Ablation. , 2015, Molecular pharmaceutics.

[86]  G. Ginsburg,et al.  Personalized medicine: revolutionizing drug discovery and patient care. , 2001, Trends in biotechnology.

[87]  Omar F. Rahman,et al.  Augmented Reality and Wearable Technology in Image-guided Navigation and Preoperative Planning , 2016, Plastic and reconstructive surgery. Global open.

[88]  Patrick Couvreur,et al.  Nanotheranostics for personalized medicine. , 2016, Advanced drug delivery reviews.

[89]  Chi H. Lee,et al.  Effects of nitric oxide on stem cell therapy. , 2015, Biotechnology advances.

[90]  Ralph Weissleder,et al.  Detection of Invasive Colon Cancer Using a Novel, Targeted, Library-Derived Fluorescent Peptide , 2004, Cancer Research.

[91]  J. Pons,et al.  Combining Dopaminergic Facilitation with Robot-Assisted Upper Limb Therapy in Stroke Survivors , 2016, American journal of physical medicine & rehabilitation.

[92]  Paolo Dario,et al.  Preliminary Findings of the AALIANCE2 Ambient Assisted Living Roadmap , 2014 .

[93]  A. Darzi,et al.  Augmented reality: 3D image-guided surgery , 2015, Cancer Imaging.

[94]  B. Garvik,et al.  Principles for the Buffering of Genetic Variation , 2001, Science.

[95]  G. Novelli,et al.  Personalized genomic medicine , 2010, Internal and emergency medicine.

[96]  E Guizzo,et al.  Robots with their heads in the clouds , 2011 .

[97]  D R Walt,et al.  Randomly ordered addressable high-density optical sensor arrays. , 1998, Analytical chemistry.

[98]  L. Osterberg,et al.  Adherence to medication. , 2005, The New England journal of medicine.

[99]  Timo Kaerlein,et al.  Minimizing the Human? Functional Reductions of Complexity in Social Robotics and Their Cybernetic Heritage , 2015 .

[100]  F. Kiessling,et al.  Personalized Nanomedicine , 2012, Clinical Cancer Research.

[101]  C. Gieger,et al.  Human metabolic individuality in biomedical and pharmaceutical research , 2011, Nature.

[102]  Jaime M. Trillos Augmented Reality for Mobile Devices in Support of Museums , 2013, Rev. Colomb. de Computación.

[103]  M. Barone,et al.  Acute pancreatitis in elderly patients: A retrospective evaluation at hospital admission. , 2016, European journal of internal medicine.

[104]  Margaret E. Prendergast,et al.  Bioinks for biofabrication: current state and future perspectives , 2017 .