Learning to Predict Performance from Formula Modeling and Training Data

This paper reports on our work and re sults framing signal processing algorithm op timization as a machine learning task A sin gle signal processing algorithm can be repre sented by many di erent but mathematically equivalent formulas When these formulas are implemented in actual code they have very di erent running times Signal process ing optimization is concerned with nding a formula that implements the algorithm as ef ciently as possible Unfortunately a correct mapping between a mathematical formula and its running time is unknown However empirical performance data can be gathered for a variety of formulas This data o ers an interesting opportunity to learn to predict running time performance In this paper we present two major results along this direc tion Di erent sets of features are iden ti ed for mathematical formulas that distin guish them into partitions with signi cantly di erent running times and A function approximator can learn to accurately predict the running time of a formula given a limited set of training data Showing the impact of selecting di erent features to describe the in put this work contributes an extensive study on the role of learning for this novel task

[1]  Manuela Veloso,et al.  Automated Formula Generation and Performance Learning for the FFT , 2000 .

[2]  Jack J. Dongarra,et al.  Automatically Tuned Linear Algebra Software , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[3]  Eric A. Brewer,et al.  High-level optimization via automated statistical modeling , 1995, PPOPP '95.

[4]  Markus Püschel,et al.  In search of the optimal Walsh-Hadamard transform , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[5]  James Demmel,et al.  Optimizing matrix multiply using PHiPAC: a portable, high-performance, ANSI C coding methodology , 1997, ICS '97.

[6]  Steven G. Johnson,et al.  FFTW: an adaptive software architecture for the FFT , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).