A reconfigurable interactive interface for controlling robotic origami in virtual environments

Origami shape transformation is dictated by predefined folding patterns and their folding sequence. The working principle of robotic origami is based on the same principle: we design quasi-two-dimensional tiles and connecting hinges and define and program their folding sequences. Since the tiles are often of uniform shape and size, their final configuration is governed by the kinematic relationship. Mathematicians, computer scientists and even architects have studied a wide range of origami algorithms. However, for multiple shape transformations, the origami design parameters and consequently sequence planning become more challenging. In this work, we present a reconfigurable interactive interface, a physics-based modeling control interface to explore the design space of origami robots. We developed two interactive modes for proof of concept of a bidirectional communication interface between virtual and physical environments. The first interaction mode is origami-inspired, foldable surfaces with distributed sensors that can recreate folding sequences and shape transformations in a virtual environment via hardware-in-loop simulation. Its complementary digital transcription lays the foundation for a robotic origami design tool that provides visual representation of various design formulations as well as an intuitive controller for robotic origami. In the second interaction mode, we construct a physics-based modeling interface for intuitive user manipulation of robotic origami in a virtual environment. Algorithms for graphical representation and command transformation were developed for robotic interaction. Lastly, we tested the efficacy of the algorithms on prototypes to discover the applications and capacities of the reconfigurable interactive interface.

[1]  Mark Yim,et al.  A Toolchain for the Design and Simulation of Foldable Programmable Matter , 2010 .

[2]  Jian S. Dai,et al.  Kinematic Analysis and Stiffness Validation of Origami Cartons , 2013 .

[3]  Daniela Rus,et al.  Foldable Joints for Foldable Robots , 2015, ISER.

[4]  Hiroshi Ishii,et al.  Physical telepresence: shape capture and display for embodied, computer-mediated remote collaboration , 2014, UIST.

[5]  Dimitris C. Lagoudas,et al.  Origami-inspired active structures: a synthesis and review , 2014 .

[6]  Robert Meyers,et al.  Real-time photorealistic virtualized reality interface for remote mobile robot control , 2010, ISRR.

[7]  Joseph A. Paradiso,et al.  SensorTape: Modular and Programmable 3D-Aware Dense Sensor Network on a Tape , 2015, UIST.

[8]  M. Alexa,et al.  Combining Shape-Changing Interfaces and Spatial Augmented Reality Enables Extended Object Appearance , 2016, CHI.

[9]  Tomohiro Tachi Geometric Considerations for the Design of Rigid Origami Structures , 2010 .

[10]  Hiroshi Ishii,et al.  Topobo: a constructive assembly system with kinetic memory , 2004, CHI.

[11]  Hiroshi Ishii,et al.  LineFORM: Actuated Curve Interfaces for Display, Interaction, and Constraint , 2015, UIST.

[12]  Larry L. Howell,et al.  A position analysis of coupled spherical mechanisms found in action origami , 2014 .

[13]  Joseph A. Paradiso,et al.  ChainFORM: A Linear Integrated Modular Hardware System for Shape Changing Interfaces , 2016, UIST.

[14]  Werner Schiehlen,et al.  Multibody System Dynamics: Roots and Perspectives , 1997 .

[15]  Robert J. Wood,et al.  Feedback-controlled self-folding of autonomous robot collectives , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Rui Peng,et al.  Origami of thick panels , 2015, Science.

[17]  Erik D. Demaine,et al.  Folding Flat Crease Patterns with Thick Materials , 2015, ArXiv.

[18]  Markus Löchtefeld,et al.  Morphees: toward high "shape resolution" in self-actuated flexible mobile devices , 2013, CHI.

[19]  A. Abbott,et al.  Characterization of creases in polymers for adaptive origami engineering , 2014 .

[20]  R. J. Wood,et al.  An Origami-Inspired Approach to Worm Robots , 2013, IEEE/ASME Transactions on Mechatronics.

[21]  R. Wood,et al.  Robotic origamis : self-morphing modular robots , 2011 .

[22]  Larry L. Howell,et al.  A Classification of Action Origami as Systems of Spherical Mechanisms , 2013 .

[23]  Larry L. Howell,et al.  Waterbomb base: a symmetric single-vertex bistable origami mechanism , 2014 .

[24]  Roel Vertegaal,et al.  An Evaluation of Shape Changes for Conveying Emotions , 2016, CHI.

[25]  M.R. Emami,et al.  An Architecture for Robotic Hardware-in-the-Loop Simulation , 2006, 2006 International Conference on Mechatronics and Automation.

[26]  Karin Schwab,et al.  Unity Game Development Essentials , 2016 .

[27]  Paul A. Beardsley,et al.  Gesture based human - Multi-robot swarm interaction and its application to an interactive display , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Ferdinando Cannella,et al.  Stiffness Characteristics of Carton Folds for Packaging , 2008 .

[29]  Matthias Müller,et al.  Position based dynamics , 2007, J. Vis. Commun. Image Represent..

[30]  Tomohiro Tachi,et al.  Rigid-Foldable Thick Origami , 2010 .

[31]  Meie Li,et al.  Predicting origami-inspired programmable self-folding of hydrogel trilayers , 2016 .

[32]  Hiroshi Ishii,et al.  Materiable: Rendering Dynamic Material Properties in Response to Direct Physical Touch with Shape Changing Interfaces , 2016, CHI.

[33]  Larry L. Howell,et al.  Identifying links between origami and compliant mechanisms , 2011 .

[34]  Devin J. Balkcom,et al.  Robotic origami folding , 2008, Int. J. Robotics Res..

[35]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[36]  Jamie Kyujin Paik,et al.  The design and control of the multi-modal locomotion origami robot, Tribot , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[37]  Jamie Kyujin Paik,et al.  A Novel Torsional Shape Memory Alloy Actuator: Modeling, Characterization, and Control , 2016, IEEE Robotics & Automation Magazine.

[38]  Burkhard Wünsche,et al.  Designing a Mixed Reality Framework for Enriching Interactions in Robot Simulation , 2010, GRAPP.

[39]  Jan Bender,et al.  Position‐based rigid‐body dynamics , 2016, Comput. Animat. Virtual Worlds.

[40]  Darren J. Hartl,et al.  Design and numerical analysis of an SMA mesh-based self-folding sheet , 2013 .

[41]  Gregory W. Reich,et al.  Characterization of Creases in Polymers for Adaptive Origami Structures (Postprint) , 2014 .

[42]  Majken Kirkegaard Rasmussen,et al.  Shape-changing interfaces: a review of the design space and open research questions , 2012, CHI.

[43]  Jamie Paik,et al.  Modeling, Characterization and Control of a Novel Torsional Shape Memory Alloy (SMA) Actuator , 2016 .

[44]  Amir Firouzeh,et al.  Robogami: A Fully Integrated Low-Profile Robotic Origami , 2015 .

[45]  Samuel M. Felton,et al.  A method for building self-folding machines , 2014, Science.

[46]  Emiko Charbonneau,et al.  Interactive 3D Model Acquisition and Tracking of Building Block Structures , 2012, IEEE Transactions on Visualization and Computer Graphics.

[47]  Jan Bender,et al.  Position-Based Simulation Methods in Computer Graphics , 2015, Eurographics.

[48]  Byoungkwon An,et al.  Designing and programming self-folding sheets , 2014, Robotics Auton. Syst..

[49]  Thomas C. Hull,et al.  Modelling the folding of paper into three dimensions using affine transformations , 2002 .

[50]  Pramod K. Varshney,et al.  Distributed detection with multiple sensors I. Fundamentals , 1997, Proc. IEEE.

[51]  Ergun Akleman,et al.  Design Tools for Patterned Self-Folding Reconfigurable Structures Based on Programmable Active Laminates , 2016 .

[52]  David Kim,et al.  FlexSense: a transparent self-sensing deformable surface , 2014, UIST.

[53]  John Norrish,et al.  Recent Progress on Programming Methods for Industrial Robots , 2010, ISR/ROBOTIK.

[54]  Daniela Rus,et al.  Ingestible, controllable, and degradable origami robot for patching stomach wounds , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[55]  Michael Eisenberg,et al.  Easigami: virtual creation by physical folding , 2012, TEI.

[56]  Henk Nijmeijer,et al.  Robot Programming by Demonstration , 2010, SIMPAR.

[57]  Tomohiro Tachi,et al.  Simulation of Rigid Origami , 2006 .

[58]  Li-Wei Chan,et al.  FlexiBend: Enabling Interactivity of Multi-Part, Deformable Fabrications Using Single Shape-Sensing Strip , 2015, UIST.

[59]  Mary Frecker,et al.  Trade Space Exploration of Magnetically Actuated Origami Mechanisms , 2016 .