Visualizations and Interaction Strategies for Hybridization Interfaces

We present two complementary approaches for the visualization and interaction of dimensionally reduced data sets using hybridization interfaces. Our implementations privilege syncretic systems allowing one to explore combinations (hybrids) of disparate elements of a data set through their placement in a 2-D space. The first approach allows for the placement of data points anywhere on the plane according to an anticipated performance strategy. The contribution (weight) of each data point varies according to a power function of the distance from the control cursor. The second approach uses constrained vertex colored triangulations of manifolds with labels placed at the vertices of triangular tiles. Weights are computed by barycentric projection of the control cursor position.

[1]  Ali Momeni,et al.  Characterizing and Controlling Musical Material Intuitively with Geometric Models , 2003, NIME.

[2]  David Wessel,et al.  Optimal Positioning in low-Dimensional control Spaces using Convex Optimization , 2005, ICMC.

[3]  Camille Goudeseune,et al.  Interpolated mappings for musical instruments , 2002, Organised Sound.

[4]  David Wessel,et al.  Timbre Space as a Musical Control Structure , 1979 .

[5]  Ali Momeni,et al.  Dynamic Independent Mapping Layers for Concurrent Control of Audio and Video Synthesis , 2006, Computer Music Journal.

[6]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[7]  Adrian Freed,et al.  A Low-level Embedded Service Architecture for Rapid DIY Design of Real-time Musical Instruments , 2009, NIME.

[8]  David Eppstein,et al.  Tiling space and slabs with acute tetrahedra , 2003, Comput. Geom..

[9]  M. Lombardi.  Interpolation and smoothing. , 2002, astro-ph/0208533.

[10]  Adrian Freed,et al.  Musical Applications and Design Techniques for the Gametrak Tethered Spatial Position Controller , 2009 .

[11]  Matthew Wright,et al.  A force sensitive multi-touch array supporting multiple 2-D musical control structures , 2007, NIME '07.

[12]  Eric Battenberg,et al.  19th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007 OPTIMIZING HEARING AIDS FOR MUSIC LISTENING , 2007 .

[13]  Frédo Durand,et al.  Texture design using a simplicial complex of morphable textures , 2005, SIGGRAPH '05.

[14]  Adrian Freed,et al.  Support Vector Machine Learning for Gesture Signal Estimation with a Piezo-Resistive Fabric Touch Surface , 2010, NIME.