Kullback-Leibler divergence measure of intermittency: Application to turbulence.

Phys Rev E

Univ Lyon, Ens de Lyon, Univ Claude Bernard, CNRS UMR 5672, Laboratoire de Physique, F-69342 Lyon, France.

Published: January 2018

For generic systems exhibiting power law behaviors, and hence multiscale dependencies, we propose a simple tool to analyze multifractality and intermittency, after noticing that these concepts are directly related to the deformation of a probability density function from Gaussian at large scales to non-Gaussian at smaller scales. Our framework is based on information theory and uses Shannon entropy and Kullback-Leibler divergence. We provide an extensive application to three-dimensional fully developed turbulence, seen here as a paradigmatic complex system where intermittency was historically defined and the concepts of scale invariance and multifractality were extensively studied and benchmarked. We compute our quantity on experimental Eulerian velocity measurements, as well as on synthetic processes and phenomenological models of fluid turbulence. Our approach is very general and does not require any underlying model of the system, although it can probe the relevance of such a model.

Download full-text PDF

Source
http://dx.doi.org/10.1103/PhysRevE.97.013107DOI Listing

Publication Analysis

Top Keywords

kullback-leibler divergence
8
divergence measure
4
measure intermittency
4
intermittency application
4
application turbulence
4
turbulence generic
4
generic systems
4
systems exhibiting
4
exhibiting power
4
power law
4

Similar Publications

Axiomatic Approach to Measures of Total Correlations.

Entropy (Basel)

December 2024

Department of Physics, Federal University of Paraná, P.O. Box 19044, Curitiba 81531-980, PR, Brazil.

Correlations play a pivotal role in various fields of science, particularly in quantum mechanics, yet their proper quantification remains a subject of debate. In this work, we aimed to discuss the challenge of defining a reliable measure of total correlations. We first outlined the essential properties that an effective correlation measure should satisfy and reviewed existing measures, including quantum mutual information, the -norm of the correlation matrix, and the recently defined quantum Pearson correlation coefficient.

View Article and Find Full Text PDF

Semi-Empirical Approach to Evaluating Model Fit for Sea Clutter Returns: Focusing on Future Measurements in the Adriatic Sea.

Entropy (Basel)

December 2024

Department of Communication and Space Technologies, Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia.

A method for evaluating Kullback-Leibler (KL) divergence and Squared Hellinger (SH) distance between empirical data and a model distribution is proposed. This method exclusively utilises the empirical Cumulative Distribution Function (CDF) of the data and the CDF of the model, avoiding data processing such as histogram binning. The proposed method converges almost surely, with the proof based on the use of exponentially distributed waiting times.

View Article and Find Full Text PDF

Fast Proxy Centers for the Jeffreys Centroid: The Jeffreys-Fisher-Rao Center and the Gauss-Bregman Inductive Center.

Entropy (Basel)

November 2024

Sony Computer Science Laboratories, Tokyo 141-0022, Japan.

The symmetric Kullback-Leibler centroid, also called the Jeffreys centroid, of a set of mutually absolutely continuous probability distributions on a measure space provides a notion of centrality which has proven useful in many tasks, including information retrieval, information fusion, and clustering. However, the Jeffreys centroid is not available in closed form for sets of categorical or multivariate normal distributions, two widely used statistical models, and thus needs to be approximated numerically in practice. In this paper, we first propose the new Jeffreys-Fisher-Rao center defined as the Fisher-Rao midpoint of the sided Kullback-Leibler centroids as a plug-in replacement of the Jeffreys centroid.

View Article and Find Full Text PDF

On Non-Random Mating, Adaptive Evolution, and Information Theory.

Biology (Basel)

November 2024

Centro de Investigación Mariña (CIM), Departamento de Bioquímica, Genética e Inmunología, Universidade de Vigo, 36310 Vigo, Spain.

Population genetics describes evolutionary processes, focusing on the variation within and between species and the forces shaping this diversity. Evolution reflects information accumulated in genomes, enhancing organisms' adaptation to their environment. In this paper, I propose a model that begins with the distribution of mating based on mutual fitness and progresses to viable adult genotype distribution.

View Article and Find Full Text PDF

In real-world scenarios, mixture models are frequently employed to fit complex data, demonstrating remarkable flexibility and efficacy. This paper introduces an innovative Pufferfish privacy algorithm based on Gaussian priors, specifically designed for Gaussian mixture models. By leveraging a sophisticated masking mechanism, the algorithm effectively safeguards data privacy.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!