Design and Analysis of Predictive Sampling of Haptic Signals

In this article, we identify adaptive sampling strategies for haptic signals. Our approach relies on experiments wherein we record the response of several users to haptic stimuli. We then learn different classifiers to predict the user response based on a variety of causal signal features. The classifiers that have good prediction accuracy serve as candidates to be used in adaptive sampling. We compare the resultant adaptive samplers based on their rate-distortion tradeoff using synthetic as well as natural data. For our experiments, we use a haptic device with a maximum force level of 3 N and 10 users. Each user is subjected to several piecewise constant haptic signals and is required to click a button whenever he perceives a change in the signal. For classification, we not only use classifiers based on level crossings and Weber’s law but also random forests using a variety of causal signal features. The random forest typically yields the best prediction accuracy and a study of the importance of variables suggests that the level crossings and Weber’s classifier features are most dominant. The classifiers based on level crossings and Weber’s law have good accuracy (more than 90%) and are only marginally inferior to random forests. The level crossings classifier consistently outperforms the one based on Weber’s law even though the gap is small. Given their simple parametric form, the level crossings and Weber’s law--based classifiers are good candidates to be used for adaptive sampling. We study their rate-distortion performance and find that the level crossing sampler is superior. For example, for haptic signals obtained while exploring various rendered objects, for an average sampling rate of 10 samples per second, the level crossings adaptive sampler has a mean square error about 3dB less than the Weber sampler.

[1]  Mark W. Spong,et al.  Bilateral control of teleoperators with time delay , 1988, Proceedings of the 1988 IEEE International Conference on Systems, Man, and Cybernetics.

[2]  I ScottKirkpatrick Optimization by Simulated Annealing: Quantitative Studies , 1984 .

[3]  Scott Kirkpatrick,et al.  Optimization by simulated annealing: Quantitative studies , 1984 .

[4]  Eckehard G. Steinbach,et al.  Disposal of explosive ordnances by use of a bimanual haptic telepresence system , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[5]  R. Weale Mechanisms of Colour Vision , 1979 .

[6]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[7]  Antonio Ortega,et al.  A comparison of different haptic compression techniques , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[8]  Sandra Hirche,et al.  Transparent Data Reduction in Networked Telepresence and Teleaction Systems. Part II: Time-Delayed Communication , 2007, PRESENCE: Teleoperators and Virtual Environments.

[9]  John Kenneth Salisbury,et al.  Haptic discrimination of force direction and the influence of visual information , 2006, TAP.

[10]  Sandra Hirche,et al.  Haptic Data Compression and Communication , 2011, IEEE Signal Processing Magazine.

[11]  E. Gamble,et al.  The Applicability of Weber's Law to Smell , 1898 .

[12]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[13]  Nizar Sakr,et al.  Robust perception-based data reduction and transmission in telehaptic systems , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[14]  Kouhei Ohnishi,et al.  Lossy data compression using FDCT for haptic communication , 2010, 2010 11th IEEE International Workshop on Advanced Motion Control (AMC).

[15]  Subhasis Chaudhuri,et al.  Haptic rendering of dense 3D point cloud data , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[16]  Josey Y. M. Chu,et al.  The failure of Weber's law in time perception and production , 2006, Behavioural Processes.

[17]  Jan A Snyman,et al.  Practical Mathematical Optimization: An Introduction to Basic Optimization Theory and Classical and New Gradient-Based Algorithms , 2005 .

[18]  Mark W. Spong,et al.  Discrete time passivity in bilateral teleoperation over the Internet , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[19]  Sandra Hirche,et al.  Transparency of haptic telepresence systems with constant time delay , 2005 .

[20]  M H Brill Weber's law and perceptual categories: another teleological view. , 1983, Bulletin of mathematical biology.

[21]  Subhasis Chaudhuri,et al.  Does Just Noticeable Difference Depend on the Rate of Change of Kinesthetic Force Stimulus? , 2014, EuroHaptics.

[22]  Eckehard G. Steinbach,et al.  A Psychophysically Motivated Compression Approach for 3D Haptic Data , 2006, 2006 14th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[23]  Kaoru Sezaki,et al.  Architecture of haptics communication system for adaptation to network environments , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[24]  Nizar Sakr,et al.  Prediction-Based Haptic Data Reduction and Transmission in Telementoring Systems , 2009, IEEE Transactions on Instrumentation and Measurement.

[25]  Alejandro Jarillo Silva,et al.  PHANToM OMNI Haptic Device: Kinematic and Manipulability , 2009, 2009 Electronics, Robotics and Automotive Mechanics Conference (CERMA).

[26]  G. Schillhuber,et al.  Telepresence across delayed networks: a combined prediction and compression approach , 2006, 2006 IEEE International Workshop on Haptic Audio Visual Environments and their Applications (HAVE 2006).

[27]  Subhasis Chaudhuri,et al.  Analysis of an Adaptive Sampler Based on Weber's Law , 2011, IEEE Transactions on Signal Processing.

[28]  Eckehard G. Steinbach,et al.  Perception-Based Compression of Haptic Data Streams Using Kalman Filters , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[29]  Sandra Hirche,et al.  A novel, psychophysically motivated transmission approach for haptic data streams in telepresence and teleaction systems , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[30]  Patrick Suppes,et al.  Representational Measurement Theory , 2002 .

[31]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[32]  Subhasis Chaudhuri,et al.  Deadzone analysis of 2D kinesthetic perception , 2014, 2014 IEEE Haptics Symposium (HAPTICS).

[33]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[34]  Sandra Hirche,et al.  Perception-Based Data Reduction and Transmission of Haptic Data in Telepresence and Teleaction Systems , 2008, IEEE Transactions on Signal Processing.

[35]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[36]  Sandra Hirche,et al.  Transparent Data Reduction in Networked Telepresence and Teleaction Systems. Part I: Communication without Time Delay , 2007, PRESENCE: Teleoperators and Virtual Environments.

[37]  R. Glynn,et al.  The Wilcoxon Signed Rank Test for Paired Comparisons of Clustered Data , 2006, Biometrics.

[38]  Shahram Payandeh,et al.  Performance evaluation of haptic data compression methods in teleoperation systems , 2011, 2011 IEEE World Haptics Conference.

[39]  Philip H. Ramsey Nonparametric Statistical Methods , 1974, Technometrics.

[40]  Sandra Hirche,et al.  Perceptual coding of haptic data in time-delayed teleoperation , 2009, World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems.

[41]  Petr Kadle Overview of current developments in haptic APIs , 2011 .

[42]  Vincent Hayward,et al.  Is there a ‘plenhaptic’ function? , 2011, Philosophical Transactions of the Royal Society B: Biological Sciences.