Development of a Basic Educational Kit for Robotic System with Deep Neural Networks

In many robotics studies, deep neural networks (DNNs) are being actively studied due to their good performance. However, existing robotic techniques and DNNs have not been systematically integrated, and packages for beginners are yet to be developed. In this study, we proposed a basic educational kit for robotic system development with DNNs. Our goal was to educate beginners in both robotics and machine learning, especially the use of DNNs. Initially, we required the kit to (1) be easy to understand, (2) employ experience-based learning, and (3) be applicable in many areas. To clarify the learning objectives and important parts of the basic educational kit, we analyzed the research and development (R&D) of DNNs and divided the process into three steps of data collection (DC), machine learning (ML), and task execution (TE). These steps were configured under a hierarchical system flow with the ability to be executed individually at the development stage. To evaluate the practicality of the proposed system flow, we implemented it for a physical robotic grasping system using robotics middleware. We also demonstrated that the proposed system can be effectively applied to other hardware, sensor inputs, and robot tasks.

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  Michael C. Yip,et al.  Motion Planning Networks , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[3]  Takashi Suehiro,et al.  A Software Platform for Component Based RT-System Development: OpenRTM-Aist , 2008, SIMPAR.

[4]  Abhinav Gupta,et al.  Supersizing self-supervision: Learning to grasp from 50K tries and 700 robot hours , 2015, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Sarmad Nozad Mahmood,et al.  Eye in hand robot arm based automated object grasping system , 2019 .

[6]  Sergey Levine,et al.  Learning Hand-Eye Coordination for Robotic Grasping with Large-Scale Data Collection , 2016, ISER.

[7]  R. Burbaite,et al.  Educational robots as collaborative learning objects for teaching Computer Science , 2013, 2013 International Conference on System Science and Engineering (ICSSE).

[8]  Sergey Levine,et al.  Sim-To-Real via Sim-To-Sim: Data-Efficient Robotic Grasping via Randomized-To-Canonical Adaptation Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Tetsuya Ogata,et al.  Compensation for Undefined Behaviors During Robot Task Execution by Switching Controllers Depending on Embedded Dynamics in RNN , 2021, IEEE Robotics and Automation Letters.

[10]  Takuya Akiba,et al.  Chainer: A Deep Learning Framework for Accelerating the Research Cycle , 2019, KDD.

[11]  Sergey Levine,et al.  End-to-End Training of Deep Visuomotor Policies , 2015, J. Mach. Learn. Res..

[12]  Shigeki Sugano,et al.  Repeatable Folding Task by Humanoid Robot Worker Using Deep Learning , 2017, IEEE Robotics and Automation Letters.

[13]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[14]  Masaki Saito,et al.  End-to-End Learning of Object Grasp Poses in the Amazon Robotics Challenge , 2020 .

[15]  Toru Ogawa,et al.  Dynamic Manipulation of Flexible Objects with Torque Sequence Using a Deep Neural Network , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[16]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[17]  Asako Kanezaki,et al.  Path Planning using Neural A* Search , 2020, ICML.

[18]  Tetsuya Ogata,et al.  Put-In-Box task generated from multiple discrete tasks by humanoid robot using deep learning , 2017 .

[19]  Nelson Baloian,et al.  Applying Pedagogical Usability for Designing a Mobile Learning Application that Support Reading Comprehension , 2019, UCAmI.

[20]  Yuki Suga,et al.  In-air Knotting of Rope using Dual-Arm Robot based on Deep Learning , 2021, 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[22]  Yuki Suga,et al.  A reusability-based hierarchical fault-detection architecture for robot middleware and its implementation in an autonomous mobile robot system , 2016, 2016 IEEE/SICE International Symposium on System Integration (SII).

[23]  Devesh K. Jha,et al.  Efficient Exploration in Constrained Environments with Goal-Oriented Reference Path , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[24]  Takashi Suehiro,et al.  RT-middleware: distributed component middleware for RT (robot technology) , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Robertas Damasevicius,et al.  Educational Robots for Internet-of-Things Supported Collaborative Learning , 2014, ICIST.

[26]  Yann LeCun,et al.  The mnist database of handwritten digits , 2005 .

[27]  Honglak Lee,et al.  Deep learning for detecting robotic grasps , 2013, Int. J. Robotics Res..

[28]  Seung-Ik Lee,et al.  OPRoS: A New Component‐Based Robot Software Platform , 2010 .

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Ian Taylor,et al.  Robotic pick-and-place of novel objects in clutter with multi-affordance grasping and cross-domain image matching , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[31]  Naoki Sakamoto,et al.  2A1-D01 Development of Reference Hardware Robotic System for Testing Intelligent RT Software Components , 2009 .

[32]  Tetsuya Ogata,et al.  Motion Switching With Sensory and Instruction Signals by Designing Dynamical Systems Using Deep Neural Network , 2017, IEEE Robotics and Automation Letters.

[33]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[34]  Savvas A. Chatzichristofis,et al.  Educational Robotics: Platforms, Competitions and Expected Learning Outcomes , 2020, IEEE Access.

[35]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.