Lazy Dragging: Effortless bounding-box drawing for touch-screen devices

Dragging rectangular boxes with a finger is among the most intuitive and popular operation to select a whole object. This work proposes a convenient method of bounding-box drawing for touch-screen devices, called Lazy Dragging. To achieve real-time and accurate performance, it first filters out explicit non-borders via graph-based segmentation. It then singles out the best four box sides among the remaining candidates using edge feature-based Random Forest. Experiments on a real-world dataset demonstrate that Lazy Dragging convincingly enhances the quality of bounding-box inputs, enabling easy object selection on small touch-screen devices.

[1]  Mario Cifrek,et al.  A brief introduction to OpenCV , 2012, 2012 Proceedings of the 35th International Convention MIPRO.

[2]  Kwanghoon Sohn,et al.  Non-parametric human segmentation using support vector machine , 2016, 2016 IEEE International Conference on Consumer Electronics (ICCE).

[3]  Bernt Schiele,et al.  What Makes for Effective Detection Proposals? , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Kwanghoon Sohn,et al.  Real-time Human Detection based on Personness Estimation , 2015, BMVC.

[5]  C. Lawrence Zitnick,et al.  Structured Forests for Fast Edge Detection , 2013, 2013 IEEE International Conference on Computer Vision.

[6]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[7]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[8]  Nikos Komodakis,et al.  LocNet: Improving Localization Accuracy for Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Kwanghoon Sohn,et al.  Personness estimation for real-time human detection on mobile devices , 2017, Expert Syst. Appl..

[10]  Ronald D Caruso,et al.  Image editing with Adobe Photoshop 6.0. , 2002, Radiographics : a review publication of the Radiological Society of North America, Inc.

[11]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[12]  C. Lawrence Zitnick,et al.  Edge Boxes: Locating Object Proposals from Edges , 2014, ECCV.

[13]  Kwanghoon Sohn,et al.  Lazy dragging: effortless bounding-box drawing for touch-screen devices , 2017, IEEE Transactions on Consumer Electronics.

[14]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Minh N. Do,et al.  Fast Global Image Smoothing Based on Weighted Least Squares , 2014, IEEE Transactions on Image Processing.

[16]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[17]  Huimin Ma,et al.  Improving object proposals with multi-thresholding straddling expansion , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[19]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[20]  Morten Hertzum,et al.  How Age Affects Pointing With Mouse and Touchpad: A Comparison of Young, Adult, and Elderly Users , 2010, Int. J. Hum. Comput. Interact..