Sensory Computing and Object Processing Entity: Assistive Robotics for Healthcare

Title of Thesis: SENSORY COMPUTING AND OBJECT PROCESSING ENTITY: ASSISTIVE ROBOTICS FOR HEALTHCARE John Bachkosky VI, Alexandra Boukhvalova, Kevin Chou, William Gunnarsson, James Ledwell, Brendan McTaggart, Xiaoqing Qian, Nicholas Rodgers, John Shi, Jason Yon Thesis directed by: Dr. Anil Deane Institute for Physical Science and Technology Team SCOPE has created an assistive robot for healthcare delivery. The robot is mobile, responds to spoken commands, and possesses Artificial Intelligence (AI). It extracts meanings about the patient’s health from conversations and visual interactions. It summarizes these observations into reports that could be merged with the patient’s Electronic Health Records (EHRs). This process aids healthcare professionals in delivering better care by augmenting attendance, increasing accuracy of patient information collection, aiding in diagnosis, streamlining data collection, and automating the process of ingesting and incorporating this information into EHR systems. SCOPE’s solution uses cloud-based AI services along with local processing. Using VEX Robotics parts and an Arduino microcontroller, SCOPE created a mobile platform for the robot. The robotic platform implements basic motions and obstacle avoidance. These separate systems are integrated using a Java master program, Node-Red, and IBM Watson cloud services. The resulting AI can be expanded for different applications within healthcare