Trapezoidal Segmented Regression: A Novel Continuous-scale Real-time Annotation Approximation Algorithm

Accurate ground truth representations of human behavior and experiences are essential for furthering our understanding of the complex relationships between everyday events and interactions and their effects on people. Producing accurate ground truth signals for subjective or latent experiences is difficult because it requires human annotation and is subject to annotator bias, distraction artifacts, valuation errors, among others. We build on previous work aiming to produce highly accurate continuous-scale ground truth labels for human experiences which advocates using supplemental human observations to warp the continuous-scale annotations to correct these errors. We propose a new method, trapezoidal segmented regression, for optimally approximating fused human-produced continuous-scale annotations to simplify its segmentation into intervals of low and high confidence in valuation. We evaluate this algorithm as an alternative to the total variation denoising method used in prior work by comparing the ground truths that both methods produce in experiments where the true annotation target signal is known a priori. Results show that the proposed signal approximation technique performs on par with the prior method, producing ground truth signals in close alignment with the true target, but with the added advantages of being more easily tuned and intuitive. We conclude that the proposed algorithm enables accurate and more robust ground truth generation.

[1]  Carlos Busso,et al.  IEMOCAP: interactive emotional dyadic motion capture database , 2008, Lang. Resour. Evaluation.

[2]  Laurent Condat,et al.  A Direct Algorithm for 1-D Total Variation Denoising , 2013, IEEE Signal Processing Letters.

[3]  Vladimir Pavlovic,et al.  Dynamic Probabilistic CCA for Analysis of Affective Behavior and Fusion of Continuous Annotations , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Carlos Busso,et al.  Correcting Time-Continuous Emotional Labels by Modeling the Reaction Lag of Evaluators , 2015, IEEE Transactions on Affective Computing.

[5]  E. Camponogara,et al.  Models and Algorithms for Optimal Piecewise-Linear Function Approximation , 2015 .

[6]  Meinard Müller,et al.  Dynamic Time Warping , 2008 .

[7]  Benedek Kurdi,et al.  Introducing the Open Affective Standardized Image Set (OASIS) , 2017, Behavior research methods.

[8]  George Trigeorgis,et al.  Deep Canonical Time Warping , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Fabien Lauer,et al.  On the complexity of piecewise affine system identification , 2015, Autom..

[10]  Stefanos Zafeiriou,et al.  Correlated-spaces regression for learning continuous emotion dimensions , 2013, MM '13.

[11]  Jeff A. Bilmes,et al.  Deep Canonical Correlation Analysis , 2013, ICML.

[12]  M. Govind,et al.  Trapezoidal and Triangular Waveform Profiles for Reducing Power Dissipation in Liquid Crystal Displays , 2008, Journal of Display Technology.

[13]  Catherine Pelachaud,et al.  The HUMAINE Database , 2011 .

[14]  Fernando De la Torre,et al.  Generalized Canonical Time Warping , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[16]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[17]  Mohammad Soleymani,et al.  A Multimodal Database for Affect Recognition and Implicit Tagging , 2012, IEEE Transactions on Affective Computing.

[18]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Aditya Jain,et al.  A comparative study of visual and auditory reaction times on the basis of gender and physical activity levels of medical first year students , 2015, International journal of applied & basic medical research.

[20]  Shrikanth S. Narayanan,et al.  A Novel Method for Human Bias Correction of Continuous- Time Annotations , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[21]  Fabien Ringeval,et al.  Introducing the RECOLA multimodal corpus of remote collaborative and affective interactions , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).