OptoSense: Towards Ubiquitous Self-Powered Ambient Light Sensing Surfaces

DINGTIAN ZHANG, Georgia Institute of Technology JUNG WOOK PARK, Georgia Institute of Technology YANG ZHANG, Carnegie Mellon University YUHUI ZHAO, Georgia Institute of Technology YIYANG WANG, Georgia Institute of Technology YUNZHI LI, Georgia Institute of Technology TANVI BHAGWAT, Georgia Institute of Technology WEN-FANG CHOU, Georgia Institute of Technology XIAOJIA JIA, Georgia Institute of Technology BERNARD KIPPELEN, Georgia Institute of Technology CANEK FUENTES-HERNANDEZ, Georgia Institute of Technology THAD STARNER, Georgia Institute of Technology GREGORY D ABOWD, Georgia Institute of Technology

[1]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[2]  Thad Starner,et al.  The locust swarm: an environmentally-powered, networkless location and messaging system , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[3]  Otmar Hilliges,et al.  Type-hover-swipe in 96 bytes: a motion sensing mechanical keyboard , 2014, CHI.

[4]  Joshua R. Smith,et al.  LoRa Backscatter: Enabling The Vision of Ubiquitous Connectivity , 2017 .

[5]  Ivan Poupyrev,et al.  Project Jacquard: Interactive Digital Textiles at Scale , 2016, CHI.

[6]  Roberta L. Klatzky,et al.  Allocentric and Egocentric Spatial Representations: Definitions, Distinctions, and Interconnections , 1998, Spatial Cognition.

[7]  Michael Rohs,et al.  Hoverflow: exploring around-device interaction with IR distance sensors , 2009, Mobile HCI.

[8]  Yang Zhang,et al.  Pulp Nonfiction: Low-Cost Touch Tracking for Paper , 2018, CHI.

[9]  M.M. Tentzeris,et al.  Only Skin Deep: Inkjet-Printed Zero-Power Sensors for Large-Scale RFID-Integrated Smart Skins , 2013, IEEE Microwave Magazine.

[10]  Jürgen Steimle,et al.  ObjectSkin: Augmenting Everyday Objects with Hydroprinted Touch Sensors and Displays , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[11]  William Buxton,et al.  ThinSight: versatile multi-touch sensing for thin form-factor displays , 2007, UIST.

[12]  Gierad Laput,et al.  Electrick: Low-Cost Touch Sensing Using Electric Field Tomography , 2017, CHI.

[13]  Qin Lv,et al.  CapBand: Battery-free Successive Capacitance Sensing Wristband for Hand Gesture Recognition , 2018, SenSys.

[14]  Bernard Kippelen,et al.  Flexible all-solution-processed all-plastic multijunction solar cells for powering electronic devices , 2016 .

[15]  R. Österbacka,et al.  Paper Electronics , 2011, Advanced materials.

[16]  Andreas M. Kunz,et al.  FLATIR: FTIR multi-touch detection on a discrete distributed sensor array , 2009, TEI.

[17]  Joshua R. Smith,et al.  WISPCam: A battery-free RFID camera , 2015, 2015 IEEE International Conference on RFID (RFID).

[18]  Michael Rohs,et al.  HoverFlow: expanding the design space of around-device interaction , 2009, Mobile HCI.

[19]  K. Ho,et al.  Performance Characterization of Dye-Sensitized Photovoltaics under Indoor Lighting. , 2017, The journal of physical chemistry letters.

[20]  B. Kippelen,et al.  Efficient Colorful Perovskite Solar Cells Using a Top Polymer Electrode Simultaneously as Spectrally Selective Antireflection Coating. , 2016, Nano letters.

[21]  Fred W. Billmeyer,et al.  IES Lighting Handbooks, 1981 Reference Volume and 1981 Applications Volume, John E. Kaufman, Ed. Illuminating Engineering Society of North America, New York, 1981, 500 pp. each. Price: $50.00 each, $90.00 set , 1981 .

[22]  David Wetherall,et al.  Ambient backscatter: wireless communication out of thin air , 2013, SIGCOMM.

[23]  Eric C. Larson,et al.  WATTR: a method for self-powered wireless sensing of water activity in the home , 2010, UbiComp.

[24]  Yang Zhang,et al.  Sozu: Self-Powered Radio Tags for Building-Scale Activity Sensing , 2019, UIST.

[25]  Shwetak N. Patel,et al.  Powering wireless sensor nodes with ambient temperature changes , 2014, UbiComp.

[26]  Joshua R. Smith,et al.  Battery-Free Cellphone , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[27]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[28]  Qiang Liu,et al.  Practical Human Sensing in the Light , 2016, GETMBL.

[29]  Geehyuk Lee,et al.  LongPad: a touchpad using the entire area below the keyboard of a laptop computer , 2013, CHI.

[30]  N. S. Sariciftci,et al.  4% Efficient Polymer Solar Cells on Paper Substrates , 2014 .

[31]  Gary R. Bradski,et al.  Motion segmentation and pose recognition with motion history gradients , 2002, Machine Vision and Applications.

[32]  Gregory D. Abowd,et al.  Serpentine: A Self-Powered Reversibly Deformable Cord Sensor for Human Input , 2019, CHI.

[33]  Wen-Fang Chou,et al.  Top-gate organic field-effect transistors fabricated on paper with high operational stability , 2017 .

[34]  Joseph A. Paradiso,et al.  Energy Scavenging with Shoe-Mounted Piezoelectrics , 2001, IEEE Micro.

[35]  Bernard Kippelen,et al.  Stable organic thin-film transistors , 2018, Science Advances.

[36]  Christian Holz,et al.  DuoSkin: rapidly prototyping on-skin user interfaces using skin-friendly materials , 2016, SEMWEB.

[37]  Xia Zhou,et al.  Human Sensing Using Visible Light Communication , 2015, MobiCom.

[38]  Shahram Izadi,et al.  SideSight: multi-"touch" interaction around small devices , 2008, UIST '08.

[39]  Raphael Wimmer,et al.  FlyEye: grasp-sensitive surfaces using optical fiber , 2010, TEI '10.

[40]  J. Paquet,et al.  Seasonal and diurnal patterns of human illumination under natural conditions. , 1998, Chronobiology international.

[41]  Barbara Stadlober,et al.  PyzoFlex: printed piezoelectric pressure sensing foil , 2012, UIST.

[42]  Shree K. Nayar,et al.  Towards Self-Powered Cameras , 2015, 2015 IEEE International Conference on Computational Photography (ICCP).

[43]  Yang Zhang,et al.  Wall++: Room-Scale Interactive and Context-Aware Sensing , 2018, CHI.

[44]  Bernard Kippelen,et al.  All-plastic solar cells with a high photovoltaic dynamic range , 2014 .

[45]  Muhammad Shahzad,et al.  Gesture Recognition Using Ambient Light , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[46]  Bernard Kippelen,et al.  Indium tin oxide-free and metal-free semitransparent organic solar cells , 2010 .

[47]  Qian Zhang,et al.  Wearables Can Afford: Light-weight Indoor Positioning with Visible Light , 2015, MobiSys.

[48]  Thiemo Voigt,et al.  Battery-free Visible Light Sensing , 2017, VLCS@MobiCom.

[49]  Xiaodan Gu,et al.  Intrinsically stretchable and healable semiconducting polymer for organic transistors , 2016, Nature.

[50]  Boris Murmann,et al.  Highly stretchable polymer semiconductor films through the nanoconfinement effect , 2017, Science.

[51]  Takao Someya,et al.  Imperceptible organic electronics , 2017 .

[52]  Xia Zhou,et al.  Self-Powered Gesture Recognition with Ambient Light , 2018, UIST.

[53]  L. T. Wong,et al.  Acceptable Illumination Levels for Office Occupants , 2006 .

[54]  Alex Olwal,et al.  I/O Braid: Scalable Touch-Sensitive Lighted Cords Using Spiraling, Repeating Sensing Textiles and Fiber Optics , 2018, UIST.

[55]  Alanson P. Sample,et al.  Design of an RFID-Based Battery-Free Programmable Sensing Platform , 2008, IEEE Transactions on Instrumentation and Measurement.

[56]  Jos B. T. M. Roerdink,et al.  The Watershed Transform: Definitions, Algorithms and Parallelization Strategies , 2000, Fundam. Informaticae.

[57]  Andruid Kerne,et al.  ZeroTouch: an optical multi-touch and free-air interaction architecture , 2012, CHI.

[58]  Gregory D. Abowd,et al.  Instant inkjet circuits: lab-based inkjet printing to support rapid prototyping of UbiComp devices , 2013, UbiComp.

[59]  Ian Marius Peters,et al.  Technology and Market Perspective for Indoor Photovoltaic Cells , 2019, Joule.

[60]  Zach M. Beiley,et al.  Modeling low cost hybrid tandem photovoltaics with the potential for efficiencies exceeding 20 , 2012 .

[61]  Tovi Grossman,et al.  Medusa: a proximity-aware multi-touch tabletop , 2011, UIST.

[62]  Albrecht Schmidt,et al.  Implicit human computer interaction through context , 2000, Personal Technologies.

[63]  Gary R. Bradski,et al.  Motion segmentation and pose recognition with motion history gradients , 2000, Proceedings Fifth IEEE Workshop on Applications of Computer Vision.

[64]  Gregory D. Abowd,et al.  SATURN: A Thin and Flexible Self-powered Microphone Leveraging Triboelectric Nanogenerator , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[65]  Shwetak N. Patel,et al.  PaperID: A Technique for Drawing Functional Battery-Free Wireless Interfaces on Paper , 2016, CHI.

[66]  Mahbub Hassan,et al.  SolarGest: Ubiquitous and Battery-free Gesture Recognition using Solar Cells , 2018, MobiCom.

[67]  Thomas M. Brown,et al.  Printed Solar Cells and Energy Storage Devices on Paper Substrates , 2019, Advanced Functional Materials.