Vision Based Office Assistant Robot System for Indoor Office Environment

This paper presents an office assistant robot that can be used in an unstructured indoor office environment. Among many technologies available, we used free and open source software and inexpensive sensors and materials to build the low cost but accurate robot. Robotic Operating System (ROS) indigo was used as the ground operating system on Ubuntu 14.04. The mobile robot, iRobot Create 2 was used as the basic robot and a structure was built to carry a mini-laptop and PrimeSense 3D vision sensor. A workstation computer was used as the central location PC which was kept still and map of office environment is built on it. User is able to give commands to the system via voice and virtual keys by the developed Android application (App). These three units, mobile robot, central workstation and Android devices, communicates through a Wi-Fi connection. The proposed robot could deliver documents or parcels in between office members according to the user commands. We allowed the robot to navigate autonomously and randomly between users and monitored its accuracy by looking at the completion of the route to a target user. Results show that the office assistant delivery robot has above 92% of accuracy in delivery process for a valid user input.

[1]  W. K. I. L. Wanniarachchi,et al.  Integrating iRobot-Arduino-Kinect Systems: An Educational Voice and Keyboard Operated Wireless Mobile Robot , 2017 .

[2]  Ashley Feniello,et al.  Reliable kinect-based navigation in large indoor environments , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  G. Reina,et al.  Adaptive Kalman Filtering for GPS-based Mobile Robot Localization , 2007, 2007 IEEE International Workshop on Safety, Security and Rescue Robotics.

[4]  Khairul Salleh Mohamed Sahari,et al.  Indoor mapping using kinect and ROS , 2015, 2015 International Symposium on Agents, Multi-Agent Systems and Robotics (ISAMSR).

[6]  S. I. A. P. Diddeniya,et al.  Voice operated home automation system based on Kinect sensor , 2016, 2016 IEEE International Conference on Information and Automation for Sustainability (ICIAfS).

[7]  Sam Ruby,et al.  RESTful Web Services , 2007 .

[8]  Jih-Gau Juang,et al.  DOCUMENT DELIVERY ROBOT BASED ON IMAGE PROCESSING AND FUZZY CONTROL , 2016 .

[9]  Avinash C. Kak,et al.  Vision-based navigation by a mobile robot with obstacle avoidance using single-camera vision and ultrasonic sensing , 1998, IEEE Trans. Robotics Autom..

[10]  M. Akbar,et al.  SPEECH RECOGNITION SYSTEM FOR A VOICE CONTROLLED ROBOT WITH REAL TIME OBSTACLE DETECTION AND AVOIDANCE , 2016 .

[11]  Alberto Elfes,et al.  Sonar-based real-world mapping and navigation , 1987, IEEE J. Robotics Autom..

[12]  Hugh Durrant-Whyte,et al.  Simultaneous Localisation and Mapping ( SLAM ) : Part I The Essential Algorithms , 2006 .

[13]  Hugh F. Durrant-Whyte,et al.  Mobile robot localization by tracking geometric beacons , 1991, IEEE Trans. Robotics Autom..

[14]  Mike Schuster,et al.  Speech Recognition for Mobile Devices at Google , 2010, PRICAI.

[15]  Gaurav Chauhan,et al.  Robotic Control using Speech Recognition and Android , 2015 .

[16]  Dieter Fox,et al.  RGB-D Mapping: Using Depth Cameras for Dense 3D Modeling of Indoor Environments , 2010, ISER.

[17]  Dieter Fox,et al.  KLD-Sampling: Adaptive Particle Filters and Mobile Robot Localization , 2001, NIPS 2001.

[18]  Kimitoshi Yamazaki,et al.  Home-Assistant Robot for an Aging Society , 2012, Proceedings of the IEEE.

[19]  Daniel O. Sales,et al.  Mobile Robots Navigation in Indoor Environments Using Kinect Sensor , 2012, 2012 Second Brazilian Conference on Critical Embedded Systems.

[20]  Kikuo Fujimura,et al.  The intelligent ASIMO: system overview and integration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  James J. Little,et al.  Vision-based mobile robot localization and mapping using scale-invariant features , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[22]  W. K. I. L. Wanniarachchi,et al.  Human Computer Interaction System for Impaired People by using Kinect Motion Sensor: Voice and Gesture Integrated Smart Home , 2018 .

[23]  W. K. I. L. Wanniarachchi,et al.  Non-Contact Human Body Parameter Measurement Based on Kinect Sensor , 2017 .

[24]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.