Battery-Free Game Boy

We present ENGAGE, the first battery-free, personal mobile gaming device powered by energy harvested from the gamer actions and sunlight. Our design implements a power failure resilient Nintendo Game Boy emulator that can run off-the-shelf classic Game Boy games like Tetris or Super Mario Land. This emulator is capable of intermittent operation by tracking memory usage, avoiding the need for always checkpointing all volatile memory, and decouples the game loop from user interface mechanics allowing for restoration after power failure. We build custom hardware that harvests energy from gamer button presses and sunlight, and leverages a mixed volatility memory architecture for efficient intermittent emulation of game binaries. Beyond a fun toy, our design represents the first battery-free system design for continuous user attention despite frequent power failures caused by intermittent energy harvesting. We tackle key challenges in intermittent computing for interaction including seamless displays and dynamic incentive-based gameplay for energy harvesting. This work provides a reference implementation and framework for a future of battery-free mobile gaming in a more sustainable Internet of Things.

[1]  Brandon Lucia,et al.  A Reconfigurable Energy Storage Architecture for Energy-harvesting Devices , 2018, ASPLOS.

[2]  Jacob Sorber,et al.  Flicker: Rapid Prototyping for the Batteryless Internet-of-Things , 2017, SenSys.

[3]  Josiah D. Hester,et al.  Reliable Timekeeping for Intermittent Computing , 2020, ASPLOS.

[4]  Thomas R. Gross,et al.  Playful Interactions with Body Channel Communication: Conquer it! , 2017, UIST.

[5]  Abu Bakar,et al.  Time-sensitive Intermittent Computing Meets Legacy Software , 2020, ASPLOS.

[6]  Yunxin Liu,et al.  RAVEN: Perception-aware Optimization of Power Consumption for Mobile Games , 2017, MobiCom.

[7]  Eli Blevis,et al.  Sustainable interaction design: invention & disposal, renewal & reuse , 2007, CHI.

[8]  Xia Zhou,et al.  Battery-Free Eye Tracker on Glasses , 2018, S3@MobiCom.

[9]  Luca Benini,et al.  Hibernus++: A Self-Calibrating and Adaptive System for Transiently-Powered Embedded Devices , 2016, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[10]  Arka Majumdar,et al.  Charging a Smartphone Across a Room Using Lasers , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[11]  Jacob Sorber,et al.  Tragedy of the Coulombs: Federating Energy Storage for Tiny, Intermittently-Powered Sensors , 2015, SenSys.

[12]  Chee Siang Ang,et al.  Exploring the Touch and Motion Features in Game-Based Cognitive Assessments , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[13]  Yoshihiro Kawahara,et al.  Room-Wide Wireless Charging and Load-Modulation Communication via Quasistatic Cavity Resonance , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[14]  Bing-Yu Chen,et al.  RFTouchPads: Batteryless and Wireless Modular Touch Sensor Pads Based on RFID , 2019, UIST.

[15]  Yogesh Kumar Meena,et al.  PV-Tiles: Towards Closely-Coupled Photovoltaic and Digital Materials for Useful, Beautiful and Sustainable Interactive Surfaces , 2020, CHI.

[16]  Brandon Lucia,et al.  A simpler, safer programming and execution model for intermittent systems , 2015, PLDI.

[17]  Daniel Vogel,et al.  Tip-Tap: Battery-free Discrete 2D Fingertip Input , 2019, UIST.

[18]  Arnab Raha,et al.  QuickRecall , 2015, ACM J. Emerg. Technol. Comput. Syst..

[19]  Brandon Lucia,et al.  Adaptive Dynamic Checkpointing for Safe Efficient Intermittent Computing , 2018, OSDI.

[20]  Robert Kovacs,et al.  DualPanto: A Haptic Device that Enables Blind Users to Continuously Interact with Virtual Worlds , 2018, UIST.

[21]  Jacob Sorber,et al.  Timely Execution on Intermittently Powered Batteryless Sensors , 2017, SenSys.

[22]  Mike Y. Chen,et al.  Clip-on gadgets: expandable tactile controls for multi-touch devices , 2012, Mobile HCI.

[23]  Jung Hwan Park,et al.  Sustainable Biomechanical Energy Scavenger toward Self-Reliant Kids’ Interactive Battery-Free Smart Puzzle , 2017 .

[24]  Ravi Jain,et al.  Challenges: environmental design for pervasive computing systems , 2002, MobiCom '02.

[25]  Azam Khan Swimming upstream in sustainable design , 2011, INTR.

[26]  Brandon Lucia,et al.  Supporting peripherals in intermittent systems with just-in-time checkpoints , 2019, PLDI.

[27]  Itiro Siio,et al.  Ohmic-Sticker: Force-to-Motion Type Input Device for Capacitive Touch Surface , 2019, CHI Extended Abstracts.

[28]  Brandon Lucia,et al.  Transactional concurrency control for intermittent, energy-harvesting computing systems , 2019, PLDI.

[29]  Kathleen Gadd,et al.  Introduction to the World of Gaming , 2009 .

[30]  Sultan A. Alharthi,et al.  Playing to Wait: A Taxonomy of Idle Games , 2018, CHI.

[31]  Junaid Haroon Siddiqui,et al.  Intermittent asynchronous peripheral operations , 2019, SenSys.

[32]  Matthew Hicks,et al.  Clank: Architectural support for intermittent computation , 2017, 2017 ACM/IEEE 44th Annual International Symposium on Computer Architecture (ISCA).

[33]  Matthew Hicks,et al.  Forget Failure: Exploiting SRAM Data Remanence for Low-overhead Intermittent Computation , 2020, ASPLOS.

[34]  Stefan Greuter,et al.  HeatCraft: Designing Playful Experiences with Ingestible Sensors via Localized Thermal Stimuli , 2019, CHI.

[35]  Alex S. Weddell,et al.  RESTOP: Retaining External Peripheral State in Intermittently-Powered Sensor Systems , 2018, Sensors.

[36]  Shahriar Nirjon,et al.  Intermittent Learning: On-Device Machine Learning on Intermittently Powered System , 2019 .

[37]  Guobin Shen,et al.  PassiveVLC: Enabling Practical Visible Light Backscatter Communication for Battery-free IoT Applications , 2017, MobiCom.

[38]  Gregory D. Abowd,et al.  SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[39]  Karthikeyan Sankaralingam,et al.  Idempotent code generation: Implementation, analysis, and evaluation , 2013, Proceedings of the 2013 IEEE/ACM International Symposium on Code Generation and Optimization (CGO).

[40]  Matthew Hicks,et al.  Intermittent Computation without Hardware Support or Programmer Intervention , 2016, OSDI.

[41]  Brandon Lucia,et al.  Dynamic Task-based Intermittent Execution for Energy-harvesting Devices , 2020, ACM Trans. Sens. Networks.

[42]  Luca Mottola,et al.  HarvOS: Efficient Code Instrumentation for Transiently-Powered Embedded Sensing , 2017, 2017 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[43]  Swarun Kumar,et al.  WiSh: Towards a Wireless Shape-aware World using Passive RFIDs , 2018, MobiSys.

[44]  Florian Mueller,et al.  Experiencing the Body as Play , 2018, CHI.

[45]  Ivan Poupyrev,et al.  Paper generators: harvesting energy from touching, rubbing and sliding , 2014, CHI Extended Abstracts.

[46]  Brandon Lucia,et al.  Chain: tasks and channels for reliable intermittent programs , 2016, OOPSLA.

[47]  Jian Xu,et al.  Ultra-Low-Power Mode for Screenless Mobile Interaction , 2018, UIST.

[48]  Fadel Adib,et al.  Drone Relays for Battery-Free Networks , 2017, SIGCOMM.

[49]  Bran Knowles,et al.  Exploring sustainability research in computing: where we are and where we go next , 2013, UbiComp.

[50]  Shengjian Jammy Chen,et al.  Designing batteryless wearables for hospitalized older people , 2019, UbiComp.

[51]  Mike Y. Chen,et al.  Clip-on gadgets: expanding multi-touch interaction area with unpowered tactile controls , 2011, UIST '11.

[52]  Allison Woodruff,et al.  A bright green perspective on sustainable choices , 2008, CHI.

[53]  Yoshihiro Kawahara,et al.  Alvus: A Reconfigurable 2-D Wireless Charging System , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[54]  Ashwin Ashok,et al.  Battery-Free Identification Token for Touch Sensing Devices , 2016, SenSys.

[55]  Shwetak N. Patel,et al.  PaperID: A Technique for Drawing Functional Battery-Free Wireless Interfaces on Paper , 2016, CHI.

[56]  Ben Kenwright Fast Efficient Fixed-Size Memory Pool: No Loops and No Overhead , 2012 .

[57]  Mahbub Hassan,et al.  SolarGest: Ubiquitous and Battery-free Gesture Recognition using Solar Cells , 2018, MobiCom.

[58]  Eli Blevis,et al.  Collapse informatics: augmenting the sustainability & ICT4D discourse in HCI , 2012, CHI.

[59]  Angli Liu,et al.  Turbocharging ambient backscatter communication , 2014, SIGCOMM.

[60]  Julie A. Kientz,et al.  "It Should Be a Game for Fun, Not Exercise": Tensions in Designing Health-Related Features for Pokémon GO , 2020, CHI.

[61]  Gaurav Khandelwal,et al.  Battery-Free Electronic Smart Toys: A Step toward the Commercialization of Sustainable Triboelectric Nanogenerators , 2018 .

[62]  Alanson P. Sample,et al.  Self-localizing battery-free cameras , 2015, UbiComp.

[63]  Sidharth Kumar,et al.  Capttery: Scalable Battery-like Room-level Wireless Power , 2019, MobiSys.

[64]  Dong Li,et al.  TagController: A Universal Wireless and Battery-free Remote Controller using Passive RFID Tags , 2017, MobiQuitous.

[65]  Joshua R. Smith,et al.  WISPCam: A battery-free RFID camera , 2015, 2015 IEEE International Conference on RFID (RFID).

[66]  Omid Salehi-Abari,et al.  Are RFID Sensing Systems Ready for the Real World? , 2019, MobiSys.

[67]  Buntarou Shizuki,et al.  AccelTag: A Passive Smart ID Tag with Acceleration Sensor for Interactive Applications , 2017, UIST.

[68]  Shwetak N. Patel,et al.  CapHarvester: A Stick-on Capacitive Energy Harvester Using Stray Electric Field from AC Power Lines , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[69]  Joshua R. Smith,et al.  Battery-free wireless identification and sensing , 2005, IEEE Pervasive Computing.

[70]  R. Venkatesha Prasad,et al.  Reincarnation in the Ambiance: Devices and Networks with Energy Harvesting , 2014, IEEE Communications Surveys & Tutorials.

[71]  Brandon Lucia,et al.  Alpaca: intermittent execution without checkpoints , 2017, Proc. ACM Program. Lang..

[72]  Joshua R. Smith,et al.  Towards Battery-Free HD Video Streaming , 2018, NSDI.

[73]  Yongjoo Kim,et al.  Achieving Stagnation-Free Intermittent Computation with Boundary-Free Adaptive Execution , 2019, 2019 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS).

[74]  Natalie D. Enright Jerger,et al.  The What's Next Intermittent Computing Architecture , 2019, 2019 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[75]  Kimiko Ryokai,et al.  EnergyBugs: energy harvesting wearables for children , 2014, CHI.

[76]  Joshua R. Smith,et al.  Battery-Free Wireless Video Streaming Camera System , 2019, 2019 IEEE International Conference on RFID (RFID).

[77]  Jeremy Gummeson,et al.  SkinnyPower: enabling batteryless wearable sensors via intra-body power transfer , 2019, SenSys.

[78]  Thomas R. Gross,et al.  Enabling Interactive Infrastructure with Body Channel Communication , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[79]  Christof Lutteroth,et al.  Virtual Performance Augmentation in an Immersive Jump & Run Exergame , 2019, CHI.

[80]  Junaid Haroon Siddiqui,et al.  Efficient intermittent computing with differential checkpointing , 2019, LCTES.

[81]  Da-Yuan Huang,et al.  RFIBricks: Interactive Building Blocks Based on RFID , 2018, CHI.

[82]  Xia Zhou,et al.  Self-Powered Gesture Recognition with Ambient Light , 2018, UIST.

[83]  Alanson P. Sample,et al.  Design of an RFID-Based Battery-Free Programmable Sensing Platform , 2008, IEEE Transactions on Instrumentation and Measurement.

[84]  C. Martin 2015 , 2015, Les 25 ans de l’OMC: Une rétrospective en photos.

[85]  Brandon Lucia,et al.  Intelligence Beyond the Edge: Inference on Intermittent Embedded Systems , 2018, ASPLOS.

[86]  Allison Woodruff,et al.  Environmental sustainability and interaction , 2007, CHI Extended Abstracts.

[87]  Wataru Yamada,et al.  CamTrackPoint: Camera-Based Pointing Stick Using Transmitted Light through Finger , 2018, UIST.

[88]  Joshua R. Smith,et al.  LoRa Backscatter: Enabling The Vision of Ubiquitous Connectivity , 2017 .

[89]  Bing-Yu Chen,et al.  RFIMatch: Distributed Batteryless Near-Field Identification Using RFID-Tagged Magnet-Biased Reed Switches , 2018, UIST.

[90]  Norman Bourassa,et al.  Toward Greener Gaming: Estimating National Energy Use and Energy Efficiency Potential , 2019, The Computer Games Journal.

[91]  Deepak Ganesan,et al.  JoyTag: a battery-less videogame controller exploiting RFID backscattering: demo , 2016, MobiCom.

[92]  Joshua R. Smith,et al.  Wi-fi backscatter , 2014, SIGCOMM 2015.

[93]  Gerhard Tröster,et al.  RFID-die: battery-free orientation sensing using an array of passive tilt switches , 2014, UbiComp Adjunct.

[94]  Joshua R. Smith,et al.  Battery-Free Cellphone , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[95]  Lei Yang,et al.  Practical Backscatter Communication Systems for Battery-Free Internet of Things: A Tutorial and Survey of Recent Research , 2018, IEEE Signal Processing Magazine.

[96]  Kanchana Thilakarathna,et al.  Low-power step counting paired with electromagnetic energy harvesting for wearables , 2018, UbiComp.

[97]  Jacob Sorber,et al.  The Future of Sensing is Batteryless, Intermittent, and Awesome , 2017, SenSys.

[98]  Pi-Cheng Hsiu,et al.  Accumulative Display Updating for Intermittent Systems , 2019, ACM Trans. Embed. Comput. Syst..

[99]  Hojung Cha,et al.  Crowdsensing-based smartphone use guide for battery life extension , 2016, UbiComp.

[100]  Eric Paulos,et al.  AlterWear: Battery-Free Wearable Displays for Opportunistic Interactions , 2018, CHI.

[101]  Changhee Jung,et al.  CoSpec: Compiler Directed Speculative Intermittent Computation , 2019, MICRO.

[102]  Brandon Lucia,et al.  Intermittent Computing: Challenges and Opportunities , 2017, SNAPL.

[103]  Regan L. Mandryk,et al.  How Points and Theme Affect Performance and Experience in a Gamified Cognitive Task , 2020, CHI.

[104]  Qin Lv,et al.  CapBand: Battery-free Successive Capacitance Sensing Wristband for Hand Gesture Recognition , 2018, SenSys.

[105]  Geoff V. Merrett,et al.  Energy-driven computing: Rethinking the design of energy harvesting systems , 2017, Design, Automation & Test in Europe Conference & Exhibition (DATE), 2017.

[106]  Przemyslaw Pawelczak,et al.  InK: Reactive Kernel for Tiny Batteryless Sensors , 2018, SenSys.

[107]  Ali Najafi,et al.  NetScatter: Enabling Large-Scale Backscatter Networks , 2018, NSDI.

[108]  Brandon Lucia,et al.  Camaroptera: a Batteryless Long-Range Remote Visual Sensing System , 2019, ENSsys@SenSys.

[109]  Yang Zhang,et al.  Sozu: Self-Powered Radio Tags for Building-Scale Activity Sensing , 2019, UIST.

[110]  Shwetak N. Patel,et al.  Powering wireless sensor nodes with ambient temperature changes , 2014, UbiComp.

[111]  Hadas Erel,et al.  Coding for Outdoor Play: a Coding Platform for Children to Invent and Enhance Outdoor Play Experiences , 2019, CHI.

[112]  Kevin Fu,et al.  Mementos: system support for long-running computation on RFID-scale devices , 2011, ASPLOS XVI.

[113]  Gregory D. Abowd,et al.  UbiquiTouch: Self Sustaining Ubiquitous Touch Interfaces , 2020, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[114]  Christof Lutteroth,et al.  Interactive Feedforward for Improving Performance and Maintaining Intrinsic Motivation in VR Exergaming , 2018, CHI.

[115]  Junaid Haroon Siddiqui,et al.  Poster Abstract: Towards Smaller Checkpoints for Better Intermittent Computing , 2018, 2018 17th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).