BUILD-IT: A Computer Vision-based Interaction Technique for a Planning Tool

In this article we wish to show a method that goes beyond the established approaches of human-computer interaction. We first bring a serious critique of traditional interface types, showing their major drawbacks and limitations. Promising alternatives are offered by Virtual (or: immersive) Reality (VR) and by Augmented Reality (AR). The AR design strategy enables humans to behave in a nearly natural way. Natural interaction means human actions in the real world with other humans and/or with real world objects. Guided by the basic constraints of natural interaction, we derive a set of recommendations for the next generation of user interfaces: the Natural User Interface (NUI). Our approach to NUIs is discussed in the form of a general framework followed by a prototype. The prototype tool builds on video-based interaction, and supports construction and plant layout. A first empirical evaluation is briefly presented.

[1]  Ben Shneiderman,et al.  Designing The User Interface , 2013 .

[2]  G.W.M. Rauterberg,et al.  From competition to collaboration through a shared social space , 1995 .

[3]  Donald A. Norman,et al.  User Centered System Design , 1986 .

[4]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[5]  Wendy E. Mackay,et al.  Back to the real world , 1993, CACM.

[6]  Andrew F. Monk,et al.  Remote assistance: a view of the work and a view of the face? , 1996, CHI Conference Companion.

[7]  Martin Bichsel,et al.  Illumination Invariant Motion Segmentation of Simple Connected Objects , 1994, BMVC.

[8]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[9]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[10]  Gwm Matthias Rauterberg,et al.  A design concept for N-dimensional user interfaces , 1995 .

[11]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[12]  Stephen W. Draper,et al.  Display Managers as the Basis for User-Machine Communication , 1986 .

[13]  William Newman,et al.  A desk supporting computer-based interaction with paper documents , 1992, CHI.

[14]  Steve Whittaker,et al.  Rethinking video as a technology for interpersonal communications: theory and design implications , 1995, Int. J. Hum. Comput. Stud..

[15]  Martin Bichsel,et al.  Segmenting Simply Connected Moving Objects in a Static Scene , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Matthias Rauterberg,et al.  Pattern recognition as a key technology for the next generation of user interfaces , 1996, 1996 IEEE International Conference on Systems, Man and Cybernetics. Information Intelligence and Systems (Cat. No.96CH35929).

[17]  Jakob Nielsen.  Book review: Designing the User Interface: Strategies for Effective Human-Computer Interaction by Ben Shneiderman (Addison-Wesley, 1987) , 1987, SGCH.

[18]  Gwm Matthias Rauterberg,et al.  Ueber die Quantifizierung software-ergonomischer Richtlinien , 1995 .

[19]  Philipp Ackermann,et al.  Developing object-oriented multimedia software : based on the MET++ application framework , 1996 .

[20]  Wendy E. Mackay,et al.  Computer-Augmented Environments: Back to the Real World - Introduction to the Special Issue. , 1993 .

[21]  Harold Thimbleby,et al.  People and computers XII : proceedings of HCI '97 , 1997 .

[22]  Bruce Tognazzini.  Tog on Software Design , 1995 .