Estimation of mutual information using copula density function

Abstract

The dependence between random variables may be measured by mutual information. However, the estimation of mutual information is difficult since the estimation of the joint probability density function (PDF) of non-Gaussian distributed data is a hard problem. Copulas offer a natural approach for estimating mutual information, since the joint probability density function of random variables can be expressed as the product of the associated copula density function and marginal PDFs. The experiment demonstrates that the proposed copulas-based mutual information is much more accurate than conventional methods such as the joint histogram and Parzen window based mutual information that are widely used in image processing.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 45 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.