Prokiwii: A Projected Portable Interface for Enriching Object Scenarios with Kinect and Wii Remote

In this paper we present an intuitive interaction technique for everyday objects. We propose a system that allows the user to interact with everyday objects, and use them to make smart scenarios. We enrich the objects with a portable projected interface that is supported by 3D accelerometer in order to build novel user object interaction scenarios. Moreover, we present double crossing as an interaction technique for manipulating finger interface. We conducted experiment to test the applicability of the proposed system with different applications. Our results showed that the proposed system has a lot of potentials to enrich different domains of applications like object data storage, education Montessori cubes and smart shopping goods.

[1]  Ivan Poupyrev,et al.  SideBySide: ad-hoc multi-user interaction with handheld projectors , 2011, UIST.

[2]  Ruigang Yang,et al.  Multi-projector display with continuous self-calibration , 2008, PROCAMS '08.

[3]  Pei-Yu Chi,et al.  Designing Smart Living Objects - Enhancing vs. Distracting Traditional Human-Object Interaction , 2007, HCI.

[4]  Naoki Kawakami,et al.  Twinkle: Interacting with physical surfaces using handheld projector , 2010, 2010 IEEE Virtual Reality Conference (VR).

[5]  Nassir Navab,et al.  Single Camera Calibration using partially visible calibration objects based on Random Dots Marker Tracking Algorithm , 2012 .

[6]  Geoff Wyvill,et al.  SIFT and SURF Performance Evaluation against Various Image Deformations on Benchmark Dataset , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[7]  Zhen Wang,et al.  uWave: Accelerometer-based Personalized Gesture Recognition and Its Applications , 2009, PerCom.

[8]  Ivan Poupyrev,et al.  Motionbeam: a metaphor for character interaction with handheld projectors , 2011, CHI.

[9]  Koji Yatani,et al.  Design of unimanual multi-finger pie menu interaction , 2011, ITS '11.

[10]  Xiang Cao,et al.  Multi-user interaction using handheld projectors , 2007, UIST.

[11]  Federica Cena,et al.  WantEat: interacting with social networks of smart objects for sharing and promoting cultural heritage , 2012, UMAP Workshops.

[12]  Max Mühlhäuser,et al.  LightBeam: nomadic pico projector interaction with real world objects , 2012, CHI EA '12.

[13]  Rita Francese,et al.  Wiimote and Kinect: gestural user interfaces add a natural third dimension to HCI , 2012, AVI.

[14]  Andrew Wilson,et al.  MirageTable: freehand interaction on a projected augmented reality tabletop , 2012, CHI.

[15]  Buntarou Shizuki,et al.  A novel click-free interaction technique for large-screen interfaces , 2006 .

[16]  Jiro Tanaka,et al.  Smart Gesture Sticker: Smart Hand Gestures Profiles for Daily Objects Interaction , 2010, 2010 IEEE/ACIS 9th International Conference on Computer and Information Science.

[17]  Andrew D. Wilson.  Using a depth camera as a touch sensor , 2010, ITS '10.

[18]  Hans-Werner Gellersen,et al.  Personal Projectors for Pervasive Computing , 2012, IEEE Pervasive Computing.

[19]  Youngbum Lee,et al.  Implementation of Accelerometer Sensor Module and Fall Detection Monitoring System based on Wireless Sensor Network , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Yang Li.  Gesture search: a tool for fast mobile data access , 2010, UIST '10.

[21]  Ahmed Atwan,et al.  A Comparative Study between SIFT- Particle and SURF-Particle Video Tracking Algorithms , 2012 .

[22]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[23]  Takashi Nakamura,et al.  Double-Crossing: A New Interaction Technique for Hand Gesture Interfaces , 2008, APCHI.

[24]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[25]  Ali Arya,et al.  Empirical study of a vision-based depth-sensitive human-computer interaction system , 2012, APCHI '12.

[26]  Tatsuo Nakajima,et al.  Augmenting everyday life with sentient artefacts , 2005, sOc-EUSAI '05.

[27]  Chris Harrison,et al.  OmniTouch: wearable multitouch interaction everywhere , 2011, UIST.