Glyph-Based Video Visualization for Semen Analysis

The existing efforts in computer assisted semen analysis have been focused on high speed imaging and automated image analysis of sperm motility. This results in a large amount of data, and it is extremely challenging for both clinical scientists and researchers to interpret, compare and correlate the multidimensional and time-varying measurements captured from video data. In this work, we use glyphs to encode a collection of numerical measurements taken at a regular interval and to summarize spatio-temporal motion characteristics using static visual representations. The design of the glyphs addresses the needs for (a) encoding some 20 variables using separable visual channels, (b) supporting scientific observation of the interrelationships between different measurements and comparison between different sperm cells and their flagella, and (c) facilitating the learning of the encoding scheme by making use of appropriate visual abstractions and metaphors. As a case study, we focus this work on video visualization for computer-aided semen analysis, which has a broad impact on both biological sciences and medical healthcare. We demonstrate that glyph-based visualization can serve as a means of external memorization of video data as well as an overview of a large set of spatiotemporal measurements. It enables domain scientists to make scientific observation in a cost-effective manner by reducing the burden of viewing videos repeatedly, while providing them with a new visual representation for conveying semen statistics.

[1]  M. Horimoto,et al.  Rat epididymal sperm motion changes induced by ethylene glycol monoethyl ether, sulfasalazine, and 2,5-hexandione. , 2000, Reproductive toxicology.

[2]  J. Rodríguez-Gil,et al.  Effects of freezing/thawing on motile sperm subpopulations of boar and donkey ejaculates. , 2008, Theriogenology.

[3]  Carl-Fredrik Westin,et al.  Diffusion Tensor Visualization with Glyph Packing , 2006, IEEE Transactions on Visualization and Computer Graphics.

[4]  Nilesh V. Patel,et al.  Video shot detection and characterization for video databases , 1997, Pattern Recognition.

[5]  Yasuyuki Matsushita,et al.  Space-Time Video Montage , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Suzanne P. Stokes,et al.  Visual Literacy in Teaching and Learning: A Literature Perspective , 2002 .

[7]  P. Tummaruk,et al.  The Use of Computer-Assisted Sperm Analysis for Discriminating Series of Motility Pattern of Frozen-thawed Boar Semen , 2010 .

[8]  R O Davis,et al.  Real-time analysis of sperm motion using automatic video image digitization. , 1985, Computer methods and programs in biomedicine.

[9]  Ariel Shamir,et al.  Improved seam carving for video retargeting , 2008, ACM Trans. Graph..

[10]  Roger Crawfis,et al.  A scientific visualization synthesizer , 1991, Proceeding Visualization '91.

[11]  W. Holt,et al.  Sperm subpopulations in boar (Sus scrofa) and gazelle (Gazella dama mhorr) semen as revealed by pattern analysis of computer-assisted motility assessments. , 1999, Biology of reproduction.

[12]  G. J. HANCOCKf,et al.  THE PROPULSION OF SEA-URCHIN SPERMATOZOA , 2005 .

[13]  Jacques Bertin,et al.  Semiology of Graphics - Diagrams, Networks, Maps , 2010 .

[14]  J. V. van Wijk,et al.  A probe for local flow field visualization , 1993, Proceedings Visualization '93.

[15]  Ravin Balakrishnan,et al.  Fluid interaction techniques for the control and annotation of digital video , 2003, UIST '03.

[16]  David H. Laidlaw,et al.  Using concepts from painting , 1999, Proceedings Visualization '99 (Cat. No.99CB37067).

[17]  Frank M. Shipman,et al.  DOTS: support for effective video surveillance , 2007, ACM Multimedia.

[18]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.

[19]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[20]  S. Mortimer,et al.  A critical review of the physiological importance and analysis of sperm movement in mammals. , 1997, Human reproduction update.

[21]  Jarke J. van Wijk,et al.  A Probe for Local Flow Field Visualization , 1993, IEEE Visualization.

[22]  Timo Ropinski,et al.  Survey of glyph-based visualization techniques for spatial multivariate medical data , 2011, Comput. Graph..

[23]  W. Krause,et al.  Estimation of sperm morphology using a new GASA system , 2009, Andrologia.

[24]  W. R. Garner,et al.  Interaction of stimulus dimensions in concept and choice processes , 1976, Cognitive Psychology.

[25]  Timo Ropinski,et al.  Taxonomy and Usage Guidelines for Glyph-based Medical Visualization , 2008, SimVis.

[26]  G. Daniel,et al.  Video visualization , 2003, IEEE Visualization, 2003. VIS 2003..

[27]  A. Tversky,et al.  Similarity of rectangles: An analysis of subjective dimensions , 1975 .

[28]  R. Shepard Attention and the metric structure of the stimulus space. , 1964 .

[29]  R. Becklen,et al.  Selective looking and the noticing of unexpected events , 1983 .

[30]  Min Chen,et al.  Visual Signatures in Video Visualization , 2006, IEEE Transactions on Visualization and Computer Graphics.

[31]  Matthew O. Ward,et al.  Multivariate Data Glyphs: Principles and Practice , 2008 .

[32]  Rupert P Amann,et al.  Reflections on CASA after 25 years. , 2004, Journal of andrology.

[33]  E. Gaffney,et al.  Nonlinear instability in flagellar dynamics: a novel modulation mechanism in sperm migration? , 2010, Journal of The Royal Society Interface.

[34]  Matthew O. Ward,et al.  A Taxonomy of Glyph Placement Strategies for Multidimensional Data Visualization , 2002, Inf. Vis..

[35]  S. Imai,et al.  The free classification of analyzable and unanalyzable stimuli , 1972 .

[36]  Richard A. Shweder,et al.  Whorf and His Critics: Linguistic and Nonlinguistic Influences on Color Memory , 1979 .

[37]  Min Chen,et al.  Action-Based Multifield Video Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[38]  Jim Davies,et al.  Taxonomy-Based Glyph Design—with a Case Study on Visualizing Workflows of Biological Experiments , 2012, IEEE Transactions on Visualization and Computer Graphics.

[39]  Robert Michael Kirby,et al.  Visualizing multivalued data from 2D incompressible flows using concepts from painting , 1999, VIS '99.

[40]  Min Chen,et al.  Glyph-based Visualization: Foundations, Design Guidelines, Techniques and Applications , 2013, Eurographics.

[41]  Timo Ropinski,et al.  Surface Glyphs for Visualizing Multimodal Volume Data , 2007, VMV.

[42]  R. Rorie,et al.  Computer-Assisted Analysis of Sperm Parameters after Selection of Motile Sperm by Either Percoll Gradient , Filtration , or Swim-up Procedures , 2022 .

[43]  Willa Kay Wiener-Ehrlich,et al.  The Relation Between Stimulus Analyzability and Perceived Dimensional Structure1 , 1978 .

[44]  Serge J. Belongie,et al.  Behavior recognition via sparse spatio-temporal features , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[45]  Min Chen,et al.  Video Visualization for Snooker Skill Training , 2010, Comput. Graph. Forum.

[46]  E. Jecht,et al.  A System for the quantitative Analysis of Human Sperm Motility , 2009, Andrologie.

[47]  Bernd Hamann,et al.  Interactive Glyph Placement for Tensor Fields , 2007, ISVC.

[48]  Robert S. Laramee,et al.  The State of the Art in Flow Visualization: Dense and Texture‐Based Techniques , 2004, Comput. Graph. Forum.

[49]  W. Holt,et al.  Applications and interpretation of computer-assisted sperm analyses and sperm sorting methods in assisted breeding and comparative research. , 2007, Reproduction, fertility, and development.

[50]  Klaus Schöffmann,et al.  Video Browsing Using Interactive Navigation Summaries , 2009, 2009 Seventh International Workshop on Content-Based Multimedia Indexing.

[51]  T. Robeck,et al.  In vitro sperm characterization and development of a sperm cryopreservation method using directional solidification in the killer whale (Orcinus orca). , 2011, Theriogenology.

[52]  Colin Ware,et al.  Visual Thinking for Design , 2008 .

[53]  S T Mortimer,et al.  CASA--practical aspects. , 2000, Journal of andrology.

[54]  Dan B. Goldman,et al.  Schematic storyboarding for video visualization and editing , 2006, ACM Trans. Graph..

[55]  A. Trocino,et al.  Correlation between CASA and ASMA parameters in rabbit semen. , 2008 .

[56]  Helwig Hauser,et al.  Visualization of Multi‐Variate Scientific Data , 2009, Comput. Graph. Forum.

[57]  S. Baba,et al.  An approach to digital image analysis of bending shapes of eukaryotic flagella and cilia , 1985 .

[58]  E A Gaffney,et al.  Bend propagation in the flagella of migrating human sperm, and its modulation by viscosity. , 2009, Cell motility and the cytoskeleton.

[59]  U. Neisser,et al.  Selective looking: Attending to visually specified events , 1975, Cognitive Psychology.

[60]  Tamara Munzner,et al.  A Nested Model for Visualization Design and Validation , 2009, IEEE Transactions on Visualization and Computer Graphics.

[61]  Organización Mundial de la Salud WHO laboratory manual for the examination and processing of human semen , 2010 .

[62]  Pierre Dragicevic,et al.  Video browsing by direct manipulation , 2008, CHI.

[63]  J. Cummins,et al.  On mammalian sperm dimensions. , 1985, Journal of reproduction and fertility.

[64]  Robert S. Laramee,et al.  The State of the Art in Flow Visualisation: Feature Extraction and Tracking , 2003, Comput. Graph. Forum.

[65]  Carlos D. Correa,et al.  Dynamic video narratives , 2010, ACM Trans. Graph..

[66]  Marion Kee,et al.  Analysis , 2004, Machine Translation.

[67]  Pak Chung Wong,et al.  Multivariate Visualization with Data Fusion , 2002, Inf. Vis..

[68]  Min Chen,et al.  MatchPad: Interactive Glyph‐Based Visualization for Real‐Time Sports Performance Analysis , 2012, Comput. Graph. Forum.

[69]  W. Gander,et al.  Least-squares fitting of circles and ellipses , 1994 .

[70]  David F. Katz,et al.  Andrology Lab Corner*: Reflections on CASA After 25 Years , 2004 .

[71]  Jürgen Döllner,et al.  Depicting dynamics using principles of visual art and narrations , 2005, IEEE Computer Graphics and Applications.

[72]  Min Chen,et al.  State of the Art Report on Video‐Based Graphics and Video Visualization , 2012, Comput. Graph. Forum.

[73]  D. Katz,et al.  Automatic analysis of human sperm motion. , 1987, Journal of andrology.

[74]  Anoop Gupta,et al.  Browsing digital video , 2000, CHI.