Playdough to Roombots: Towards a Novel Tangible User Interface for Self-reconfigurable Modular Robots

One of the main strengths of self-reconfigurable modular robots (SRMR) is their ability to shape-shift and dynamically change their morphology. In the case of our SRMR system “Roombots”, these shapes can be quite arbitrary for a great variety of tasks while the major utility is envisioned to be self-reconfigurable furniture. As such, the ideas and inspirations from users quickly need to be translated into the final Roombots shape. This involves a multitude of separate processes and - most importantly - requires an intuitive user interface. Our current approach led to the development of a tangible user interface (TUI) which involves 3D-scanning of a shape formed by modeling clay and the necessary steps to prepare the digitized model to be formed by Roombots. The system is able to generate a solution in less than two minutes for our target use as demonstrated with various examples.

[1]  Radhika Nagpal,et al.  Self-repair through scale independent self-reconfiguration , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[2]  Auke Jan Ijspeert,et al.  Natural user interface for lighting control: Case study on desktop lighting using modular robots , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[3]  Hiroshi Ishii,et al.  KidCAD: digitally remixing toys through tangible tools , 2012, CHI.

[4]  Hiroshi Ishii,et al.  Illuminating clay: a 3-D tangible interface for landscape analysis , 2002, CHI.

[5]  Hiroshi Ishii,et al.  Materiable: Rendering Dynamic Material Properties in Response to Direct Physical Touch with Shape Changing Interfaces , 2016, CHI.

[6]  Gregory S. Chirikjian,et al.  Modular Self-Reconfigurable Robot Systems [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[7]  Yoshifumi Kitamura,et al.  Interactive retrieval of 3D shape models using physical objects , 2004, MULTIMEDIA '04.

[8]  Hiroshi Ishii,et al.  Radical atoms: beyond tangible bits, toward transformable materials , 2012, INTR.

[9]  Kasper Støy,et al.  Using cellular automata and gradients to control self-reconfiguration , 2006, Robotics Auton. Syst..

[10]  Paul A. Beardsley,et al.  Tangible interaction + graphical interpretation: a new approach to 3D modeling , 2000, SIGGRAPH.

[11]  Daniela Rus,et al.  M-blocks: Momentum-driven, magnetic modular robots , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Y Wang,et al.  Bringing Clay and Sand into Digital Design — Continuous Tangible user Interfaces , 2004 .

[13]  Auke Jan Ijspeert,et al.  Locomotion through Reconfiguration based on Motor Primitives for Roombots Self-Reconfigurable Modular Robots , 2012, ROBOTIK.

[14]  Samuel Johnson,et al.  Squishy circuits: a tangible medium for electronics education , 2010, CHI EA '10.

[15]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[16]  Auke Jan Ijspeert,et al.  Roombots: A hardware perspective on 3D self-reconfiguration and locomotion with a homogeneous modular robot , 2014, Robotics Auton. Syst..

[17]  Hiroshi Ishii,et al.  Topobo: a constructive assembly system with kinetic memory , 2004, CHI.

[18]  Yunbo Zhang,et al.  RevoMaker: Enabling Multi-directional and Functionally-embedded 3D printing using a Rotational Cuboidal Platform , 2015, UIST.

[19]  Auke Jan Ijspeert,et al.  Natural user interface for Roombots , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[20]  Sandeep Patil,et al.  Voxel-based representation, display and thickness analysis of intricate shapes , 2005, Ninth International Conference on Computer Aided Design and Computer Graphics (CAD-CG'05).

[21]  Andrew W. Fitzgibbon,et al.  KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera , 2011, UIST.

[22]  Patrick Jermann,et al.  Design and evaluation of a graphical iPad application for arranging adaptive furniture , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[23]  Benjamin Kading,et al.  Characterization of a Large, Low-Cost 3D Scanner , 2015 .