Live Demonstration: Sensor Automation Platform and Multi-sensor Badge for the Sensory Impaired

For this demonstration, we present a sensor automation software platform, dubbed eGor [1], interfacing with a custom wearable multi-sensor “badge” designed to augment the awareness of humans with sensory impairment. To test and operate the multi-sensor badge, the eGor platform is a digital laboratory assistant that enable users to remotely automate instruments with precise timing control and automatically collect results datasets as a digital object. The eGor platform is a collection of user-friendly browser-based tools that achieve individual functions. The Designer tool, for instance, manages a digital inventory of instruments and digitally creates measurement and test procedures. The Executer tool provides scheduled or real-time data acquisition, enabling developers to inspect multiple sensors at once and automatically generate digital objects tagged with meta-data. Finally, eGor provides an Analyzer tool that allows the user to search and curate digital objects and view or process the datasets within. In this demonstration, the eGor tools will be used to constantly observe datasets collected by the wearable multi-sensor badge and inform the user through a haptic feedback mechanism. The eGor platform serves both as a sensor characterization tool and, in this demonstration, as an element of an assistive device. The demonstrated system will provide users with a “sixth sense”, augmenting their awareness with a machine-generated understanding of their surrounding environment that may not be available to some sensory impaired humans.

[1]  Andrew J. Mason,et al.  Platform for Autonomous Sensor Characterization and Generation of Provenance-Aware Datasets , 2018, 2018 IEEE 61st International Midwest Symposium on Circuits and Systems (MWSCAS).