External Labeling Techniques: A Taxonomy and Survey

External labeling is frequently used for annotating features in graphical displays and visualizations, such as technical illustrations, anatomical drawings, or maps, with textual information. Such a labeling connects features within an illustration by thin leader lines with their labels, which are placed in the empty space surrounding the image. Over the last twenty years, a large body of literature in diverse areas of computer science has been published that investigates many different aspects, models, and algorithms for automatically placing external labels for a given set of features. This state‐of‐the‐art report introduces a first unified taxonomy for categorizing the different results in the literature and then presents a comprehensive survey of the state of the art, a sketch of the most relevant algorithmic techniques for external labeling algorithms, as well as a list of open research challenges in this multidisciplinary research field.

[1]  Ravindra K. Ahuja,et al.  Network Flows: Theory, Algorithms, and Applications , 1993 .

[2]  Frank Wagner,et al.  A packing problem with applications to lettering of maps , 1991, SCG '91.

[3]  Peter Eades,et al.  A Heuristics for Graph Drawing , 1984 .

[4]  Christopher Collins,et al.  Abbreviating Text Labels on Demand , 2017 .

[5]  Jan-Henrik Haunert,et al.  Labeling circular focus regions based on a tractable case of maximum weight independent set of rectangles , 2014, MapInteract '14.

[6]  Joe Marks,et al.  An empirical study of algorithms for point-feature label placement , 1995, TOGS.

[7]  Martin Nöllenburg,et al.  On the readability of leaders in boundary labeling , 2018, Inf. Vis..

[8]  Daniel Vogel,et al.  Specifying label layout style by example , 2007, UIST.

[9]  Hsu-Chun Yen,et al.  Boundary Labeling in Text Annotation , 2009, 2009 13th International Conference Information Visualisation.

[10]  Bernhard Preim,et al.  Automatic Textual Annotation for Surgical Planning , 2009, VMV.

[11]  Jason Dykes,et al.  Spatially Ordered Treemaps , 2008, IEEE Transactions on Visualization and Computer Graphics.

[12]  Torsten Kuhlen,et al.  Automated Positioning of Annotations in Immersive Virtual Environments , 2010, EGVE/EuroVR/VEC.

[13]  Niklas Elmqvist,et al.  Fluid interaction for information visualization , 2011, Inf. Vis..

[14]  Micha Sharir,et al.  Vertical decomposition of shallow levels in 3-dimensional arrangements and its applications , 1995, SCG '95.

[15]  Jirí Bittner,et al.  Layout-aware optimization for interactive labeling of 3D models , 2010, Comput. Graph..

[16]  Angie Taylor.  Chapter 06 – Grouping , 2006 .

[17]  Stefan Bruckner,et al.  TECHNICAL REPORT VolumeShop: An Interactive System for Direct Volume , 2022 .

[18]  Heidrun Schumann,et al.  Adaptive Labeling for Interactive Mobile Information Systems , 2006, Tenth International Conference on Information Visualisation (IV'06).

[19]  Ladislav Čmolík,et al.  Real-Time External Labeling of Ghosted Views , 2019, IEEE Transactions on Visualization and Computer Graphics.

[20]  Martin Nöllenburg,et al.  Algorithms for Multi-Criteria Boundary Labeling , 2009, J. Graph Algorithms Appl..

[21]  Timo Götzelmann,et al.  Metrics for Functional and Aesthetic Label Layouts , 2005, Smart Graphics.

[22]  Wencheng Wu,et al.  Perception-based line quality measurement , 2005, IS&T/SPIE Electronic Imaging.

[23]  Martin Nöllenburg,et al.  Dynamic one-sided boundary labeling , 2010, GIS '10.

[24]  Alexander Wolff,et al.  A Practical Map Labeling Algorithm , 1997, Comput. Geom..

[25]  Alexander Wolff,et al.  Algorithms for Labeling Focus Regions , 2012, IEEE Transactions on Visualization and Computer Graphics.

[26]  Timo Götzelmann,et al.  Contextual Grouping of Labels , 2006, SimVis.

[27]  Mark de Berg,et al.  Computational geometry: algorithms and applications , 1997 .

[28]  Nadine Schwartges,et al.  Labeling Streets Along a Route in Interactive 3D Maps Using Billboards , 2015, AGILE Conf..

[29]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[30]  Alexander Wolff,et al.  Multi-sided Boundary Labeling , 2015, Algorithmica.

[31]  Chee-Keng Yap,et al.  Dynamic Map Labeling , 2006, IEEE Transactions on Visualization and Computer Graphics.

[32]  Xavier Décoret,et al.  Dynamic label placement for improved interactive exploration , 2008, NPAR.

[33]  Robert E. Tarjan,et al.  One-Processor Scheduling with Symmetric Earliness and Tardiness Penalties , 1988, Math. Oper. Res..

[34]  Timo Götzelmann,et al.  Form Follows Function: Aesthetic Interactive Labels , 2005, CAe.

[35]  Timo Götzelmann,et al.  Agent-Based Annotation of Interactive 3D Visualizations , 2006, Smart Graphics.

[36]  H. Kuhn.  The Hungarian method for the assignment problem , 1955 .

[37]  Hsu-Chun Yen,et al.  Many-to-one boundary labeling , 2007, 2007 6th International Asia-Pacific Symposium on Visualization.

[38]  Alexander Wolff,et al.  Boundary labeling: Models and efficient algorithms for rectangular maps , 2004, Comput. Geom..

[39]  Hsu-Chun Yen,et al.  One-and-a-Half-Side Boundary Labeling , 2011, COCOA.

[40]  Maarten Löffler,et al.  Shooting bricks with orthogonal laser beams: A first step towards internal/external map labeling , 2010, CCCG.

[41]  Jan-Henrik Haunert,et al.  Multirow Boundary-Labeling Algorithms for Panorama Images , 2015, TSAS.

[42]  Hsu-Chun Yen,et al.  A Zone-Based Approach for Placing Annotation Labels on Metro Maps , 2011, Smart Graphics.

[43]  Helen C. Purchase,et al.  Which Aesthetic has the Greatest Effect on Human Understanding? , 1997, GD.

[44]  Michael A. Bekos,et al.  Boundary Labeling with Octilinear Leaders , 2009, Algorithmica.

[45]  E. Imhof.  Positioning Names on Maps , 1975 .

[46]  Dieter Schmalstieg,et al.  Hedgehog labeling: View management techniques for external labels in 3D space , 2014, 2014 IEEE Virtual Reality (VR).

[47]  Sheung-Hung Poon,et al.  Boundary Labeling with Flexible Label Positions , 2014, WALCOM.

[48]  Martin Nöllenburg,et al.  Radial contour labeling with straight leaders , 2017, 2017 IEEE Pacific Visualization Symposium (PacificVis).

[49]  Alexander Wolff,et al.  Luatodonotes: Boundary Labeling for Annotations in Texts , 2014, GD.

[50]  Heidrun Schumann,et al.  Particle-based labeling: Fast point-feature labeling without obscuring other visual features , 2008, IEEE Transactions on Visualization and Computer Graphics.

[51]  Bernhard Preim,et al.  Constrained Labeling of 2D Slice Data for Reading Images in Radiology , 2012, VCBM.

[52]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[53]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[54]  Michael A. Bekos,et al.  Many-to-One Boundary Labeling with Backbones , 2015, J. Graph Algorithms Appl..

[55]  Masatoshi Arikawa,et al.  Designing and Annotating Metro Maps with Loop Lines , 2015, 2015 19th International Conference on Information Visualisation.

[56]  Alexander Wolff,et al.  Boundary labeling: Models and efficient algorithms for rectangular maps , 2004, Comput. Geom..

[57]  Subhash Suri,et al.  Boundary Labeling with Obstacles , 2016, CCCG.

[58]  Clifford H. Wood.  A Descriptive and Illustrated Guide for Type Placement on Small Scale Maps , 2000 .

[59]  Hsu-Chun Yen,et al.  Travel‐Route‐Centered Metro Map Layout and Annotation , 2012, Comput. Graph. Forum.

[60]  Sumio Masuda,et al.  Crossing Minimization in Linear Embeddings of Graphs , 1990, IEEE Trans. Computers.

[61]  Ioannis G. Tollis,et al.  Automatic Placement of Labels in Maps and Drawings , 2018, Handbook of Approximation Algorithms and Metaheuristics.

[62]  Sarah E. Battersby,et al.  Ring maps for spatial visualization of multivariate epidemiological data , 2011 .

[63]  Knut Hartmann,et al.  Label Layout for Interactive 3D Illustrations , 2005, J. WSCG.

[64]  Peter Eades,et al.  A Heuristic for Graph Drawing , 1984 .

[65]  Prosenjit Bose,et al.  Boundary Labeling for Rectangular Diagrams , 2018, SWAT.

[66]  Sabine Storandt,et al.  Scalability of Route Planning Techniques , 2018, ICAPS.

[67]  Michael A. Bekos,et al.  Multi-stack Boundary Labeling Problems , 2006, FSTTCS.

[68]  Alexander Wolff,et al.  Labeling Subway Lines , 2001, ISAAC.

[69]  Steven K. Feiner,et al.  View management for virtual and augmented reality , 2001, UIST '01.

[70]  Maarten Löffler,et al.  Mixed Map Labeling , 2015, CIAC.

[71]  Ronald Azuma,et al.  Evaluating label placement for augmented reality view management , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[72]  Michael A. Bekos,et al.  Efficient Labeling of Collinear Sites , 2008, J. Graph Algorithms Appl..

[73]  Bernhard Preim,et al.  Survey of Labeling Techniques in Medical Visualizations , 2014, VCBM.

[74]  Chandler Stolp,et al.  The Visual Display of Quantitative Information , 1983 .

[75]  Michael A. Bekos,et al.  Polygon labelling of minimum leader length , 2006, APVIS.

[76]  Roberto Tamassia,et al.  Handbook on Graph Drawing and Visualization , 2013 .

[77]  Robert J. Vanderbei,et al.  Linear Programming: Foundations and Extensions , 1998, Kluwer international series in operations research and management service.

[78]  Dieter Schmalstieg,et al.  Dynamic compact visualizations for augmented reality , 2013, 2013 IEEE Virtual Reality (VR).

[79]  Jürgen Döllner,et al.  Efficient View Management for Dynamic Annotation Placement in Virtual Landscapes , 2006, Smart Graphics.

[80]  Micha Sharir,et al.  Vertical Decomposition of Shallow Levels in 3-Dimensional Arrangements and Its Applications , 1999, SIAM J. Comput..

[81]  Stephen R. Ellis,et al.  Objective and subjective assessment of stereoscopically separated labels in augmented reality , 2009, Comput. Graph..

[82]  A. M. Voorhees,et al.  A general theory of traffic movement , 2013 .

[83]  Jean-Daniel Fekete,et al.  Excentric labeling: dynamic neighborhood labeling for data visualization , 1999, CHI '99.

[84]  Alexander Wolff,et al.  Graph Drawing and Cartography , 2013, Handbook of Graph Drawing and Visualization.

[85]  Michael Kaufmann,et al.  Boundary Labeling Methods for Dynamic Focus Regions , 2014, 2014 IEEE Pacific Visualization Symposium.

[86]  Michael A. Bekos,et al.  Combining Traditional Map Labeling with Boundary Labeling , 2011, SOFSEM.

[87]  Pravin M. Vaidya,et al.  Geometry helps in matching , 1989, STOC '88.

[88]  Stefan Buschmann,et al.  OpenLL: An API for Dynamic 2D and 3D Labeling , 2018, 2018 22nd International Conference Information Visualisation (IV).

[89]  Yalong Yang,et al.  Many-to-Many Geographically-Embedded Flow Visualisation: An Evaluation , 2019, IEEE Transactions on Visualization and Computer Graphics.

[90]  Michael Kaufmann.  On Map Labeling with Leaders , 2009, Efficient Algorithms.

[91]  Christos Koulamas.  Single-machine scheduling with time windows and earliness/tardiness penalties , 1996 .

[92]  Maurizio Rigamonti,et al.  Extended Excentric Labeling , 2009, Comput. Graph. Forum.

[93]  Knut Hartmann,et al.  Floating Labels: Applying Dynamic Potential Fields for Label Layout , 2004, Smart Graphics.

[94]  Chun-Cheng Lin.  Crossing-free many-to-one boundary labeling with hyperleaders , 2010, 2010 IEEE Pacific Visualization Symposium (PacificVis).

[95]  Joseph S. B. Mitchell,et al.  An Algorithm for the Maximum Weight Independent Set Problem onOutersting Graphs , 2015, CCCG.

[96]  Nancy Argüelles,et al.  Author ' s , 2008 .

[97]  Asaf Degani.  On the typography of flight-deck documentation , 1992 .

[98]  Michael A. Bekos,et al.  Area-Feature Boundary Labeling , 2010, Comput. J..

[99]  Peter Brucker,et al.  Scheduling Algorithms , 1995 .

[100]  Colin Ware,et al.  Cognitive Measurements of Graph Aesthetics , 2002, Inf. Vis..

[101]  Claus B. Madsen,et al.  Temporal Coherence Strategies for Augmented Reality Labeling , 2016, IEEE Transactions on Visualization and Computer Graphics.

[102]  David A. Bader,et al.  Benchmarking for Graph Clustering and Partitioning , 2014, Encyclopedia of Social Network Analysis and Mining.

[103]  Peter Eades,et al.  Edge crossings in drawings of bipartite graphs , 1994, Algorithmica.

[104]  Michael A. Bekos,et al.  Boundary Labeling with Octilinear Leaders , 2008, SWAT.

[105]  Zdenek Míkovec,et al.  On the selection of 2D objects using external labeling , 2014, CHI.

[106]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[107]  Edward Rolf Tufte,et al.  The visual display of quantitative information , 1985 .