Calculation of Entropy and Mutual Information for Sinusoids

Abstract : In this work, an analytical expression is developed for the differential entropy of a sinusoid. The mutual information between two sinusoids with different amplitudes and phase is then derived using both continuous and discrete entropies.