Design and evaluation of a perceptual-based object group selection technique

Selecting groups of objects is a frequent task in graphical user interfaces since it precedes all manipulation operations. Current selection techniques such as lasso become time-consuming and error-prone in dense configurations or when the area covered by targets is large or hard to reach. Perceptual-based selection techniques can considerably improve the selection task when the targets have a perceptual structure, driven by Gestalt principles of proximity and good continuity. However, current techniques use ad hoc grouping algorithms that often lack evidence from perception science. Moreover, they do not allow selecting arbitrary groups (i.e. without a perceptual structure) or modifying a selection. This paper presents a domain-independent perceptual-based selection technique that addresses these issues. It is built upon an established group detection model from perception research and provides intuitive interaction techniques for selecting (whole or partial) groups with curvilinear or random structures. Our user study shows that this technique not only outperforms rectangle selection and lasso techniques when targets have perceptual structure, but also it is competitive when targets have arbitrary arrangements.

[1]  Frank M. Shipman,et al.  Parsing and interpreting ambiguous structures in spatial hypermedia , 2005, HYPERTEXT '05.

[2]  Eric Saund,et al.  Perceptual organization in an interactive sketch editing application , 1995, Proceedings of IEEE International Conference on Computer Vision.

[3]  Kristinn R. Thórisson,et al.  Simulated Perceptual Grouping: An Application to Human-Computer Interaction , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.

[4]  Jacob Feldman,et al.  Perceptual Models of Small Dot Clusters , 1993, Partitioning Data Sets.

[5]  Frank M. Shipman,et al.  VIKI: spatial hypertext supporting emergent structure , 1994, ECHT '94.

[6]  Shumin Zhai,et al.  More than dotting the i's --- foundations for crossing-based interfaces , 2002, CHI.

[7]  Erich Rome,et al.  Simulating Perceptual Clustering by Gestalt Principles Erich Rome , 2001 .

[8]  Sachi Mizobuchi,et al.  Tapping vs. circling selections on pen-based devices: evidence for different performance-shaping factors , 2004, CHI '04.

[9]  Wolfgang Stuerzlinger,et al.  Intelligent Mouse-Based Object Group Selection , 2008, Smart Graphics.

[10]  Nicholas Chen,et al.  Phrasing techniques for multi-stroke selection gestures , 2006, Graphics Interface.

[11]  Thomas P. Moran,et al.  Implicit structure for pen-based systems within a freeform interaction paradigm , 1995, CHI '95.

[12]  Thomas P. Moran,et al.  Pen-based interaction techniques for organizing material on an electronic whiteboard , 1997, UIST '97.

[13]  Satoshi Matsuoka,et al.  Adaptive recognition of implicit structures in human-organized layouts , 1995, Proceedings of Symposium on Visual Languages.

[14]  Robert Weibel,et al.  A Multi-parameter Approach to Automated Building Grouping and Generalization , 2008, GeoInformatica.

[15]  J. Feldman Curvilinearity, covariance, and regularity in perceptual groups , 1997, Vision Research.

[16]  Lynn Wilcox,et al.  A dynamic grouping technique for ink and audio notes , 1998, UIST '98.

[17]  Frank M. Shipman,et al.  Finding and using implicit structure in human-organized spatial layouts of information , 1995, CHI '95.

[18]  Eric Saund,et al.  Sloppy selection: Providing an accurate interpretation of imprecise selection gestures , 2005, Comput. Graph..