Medication Name Comprehension of Intelligent Virtual Assistants: A Comparison of Amazon Alexa, Google Assistant, and Apple Siri Between 2019 and 2021

The current study was a replication and comparison of our previous research which examined the comprehension accuracy of popular intelligent virtual assistants, including Amazon Alexa, Google Assistant, and Apple Siri for recognizing the generic and brand names of the top 50 most dispensed medications in the United States. Using the exact same voice recordings from 2019, audio clips of 46 participants were played back to each device in 2021. Google Assistant achieved the highest comprehension accuracy for both brand medication names (86.0%) and generic medication names (84.3%), followed by Apple Siri (brand names = 78.4%, generic names = 75.0%), and the lowest accuracy by Amazon Alexa (brand names 64.2%, generic names = 66.7%). These findings represent the same trend of results as our previous research, but reveal significant increases of ~10–24% in performance for Amazon Alexa and Apple Siri over the past 2 years. This indicates that the artificial intelligence software algorithms have improved to better recognize the speech characteristics of complex medication names, which has important implications for telemedicine and digital healthcare services.

[1]  Teresa K. O'Leary,et al.  Patient and Consumer Safety Risks When Using Conversational Assistants for Medical Information: An Observational Study of Siri, Alexa, and Google Assistant , 2018, Journal of medical Internet research.

[2]  Simon M. Lin,et al.  Readiness for voice assistants to support healthcare delivery during a health crisis and pandemic. , 2020, NPJ digital medicine.

[3]  Adam S. Miner,et al.  Smartphone-Based Conversational Agents and Responses to Questions About Mental Health, Interpersonal Violence, and Physical Health. , 2016, JAMA internal medicine.

[4]  Nick Wilson,et al.  Just ask Siri? A pilot study comparing smartphone digital assistants and laptop Google searches for smoking cessation advice , 2018, PloS one.

[5]  Simon M. Lin,et al.  Clinical Advice by Voice Assistants on Postpartum Depression: Cross-Sectional Investigation Using Apple Siri, Amazon Alexa, Google Assistant, and Microsoft Cortana , 2021, JMIR mHealth and uHealth.

[6]  Matthew B Hoy.  Alexa, Siri, Cortana, and More: An Introduction to Voice Assistants , 2018, Medical reference services quarterly.

[7]  Andrea V Fuentes,et al.  Comprehension of Top 200 Prescribed Drugs in the US as a Resource for Pharmacy Teaching, Training and Practice , 2018, Pharmacy.

[8]  D. K. Ho.  Voice-controlled virtual assistants for the older people with visual impairment , 2018, Eye.

[9]  J. Ayers,et al.  Responses to addiction help-seeking from Alexa, Siri, Google Assistant, Cortana, and Bixby intelligent virtual assistants. , 2020, NPJ digital medicine.

[10]  A. Palanica,et al.  Do you understand the words that are comin outta my mouth? Voice assistant comprehension of medication names , 2019, npj Digital Medicine.