Using the maximum entropy method to estimate probability density functions for oceanographic and acoustic parameters

The maximum entropy (MaxEnt) method offers a powerful means of estimating the probability density functions (pdf’s) of measured data. Traditionally, pdf’s have been estimated by fitting data to particular distributions (e.g., Gaussian, log‐normal, Rayleigh, chi‐squared, etc.). This approach can lead to misleading results, especially if the data are highly skewed or kurtotic. First published in 1957 by Jaynes [E. T. Jaynes, Phys. Rev., 106, 620–630 (1957)], MaxEnt has gained wide use in recent years. The method uses Lagrangian multipliers to maximize the entropy, a measure of uncertainty, subject to specified constraints. The result is a pdf that Jaynes describes as being the ‘‘least biased estimate possible on the given information; i.e., it is maximally noncommittal with regard to missing information.’’ In other words, all possibilities under the given constraints are considered equally. This method is particularly useful in determining prior pdf’s based on limited measurements. MaxEnt pdf’s, which belon...