Selecting an Effective Entropy Estimator for Short Sequences of Bits and Bytes with Maximum Entropy.

Entropy (Basel)

Facultad de Ciencias Económicas y Empresariales, Universidad Panamericana, Álvaro del Portillo 49, Zapopan, Jalisco 45010, México.

Published: April 2021

Entropy makes it possible to measure the uncertainty about an information source from the distribution of its output symbols. It is known that the maximum Shannon's entropy of a discrete source of information is reached when its symbols follow a Uniform distribution. In cryptography, these sources have great applications since they allow for the highest security standards to be reached. In this work, the most effective estimator is selected to estimate entropy in short samples of bytes and bits with maximum entropy. For this, 18 estimators were compared. Results concerning the comparisons published in the literature between these estimators are discussed. The most suitable estimator is determined experimentally, based on its bias, the mean square error short samples of bytes and bits.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC8147137PMC
http://dx.doi.org/10.3390/e23050561DOI Listing

Publication Analysis

Top Keywords

maximum entropy
8
short samples
8
samples bytes
8
bytes bits
8
entropy
6
selecting effective
4
effective entropy
4
entropy estimator
4
estimator short
4
short sequences
4

Similar Publications

Generative artificial intelligence (AI) models trained on natural protein sequences have been used to design functional enzymes. However, their ability to predict individual reaction steps in enzyme catalysis remains unclear, limiting the potential use of sequence information for enzyme engineering. In this study, we demonstrated that sequence information can predict the rate of the S2 step of a haloalkane dehalogenase using a generative maximum-entropy (MaxEnt) model.

View Article and Find Full Text PDF

Inward rectifying potassium (Kir) channels play a critical role in maintaining the resting membrane potential and cellular homeostasis. The high-resolution crystal structure of homotetrameric KirBac1.1 in detergent micelles provides a snapshot of the closed state.

View Article and Find Full Text PDF

Adolescent-onset schizophrenia (AOS) is relatively rare, under-studied, and associated with more severe cognitive impairments and poorer outcomes than adult-onset schizophrenia. Neuroimaging has shown altered regional activations (first-order effects) and functional connectivity (second-order effects) in AOS compared to controls. The pairwise maximum entropy model (MEM) integrates first- and second-order factors into a single quantity called energy, which is inversely related to probability of occurrence of brain activity patterns.

View Article and Find Full Text PDF

Assessment of temporal aggregation of Sentinel-2 images on seasonal land cover mapping and its impact on landscape metrics.

Environ Monit Assess

January 2025

Universidad Nacional de Córdoba - Facultad de Ciencias Agropecuarias, X5000HUA, Córdoba, Argentina.

Landscape metrics (LM) play a crucial role in fields such as urban planning, ecology, and environmental research, providing insights into the ecological and functional dynamics of ecosystems. However, in dynamic systems, generating thematic maps for LM analysis poses challenges due to the substantial data volume required and issues such as cloud cover interruptions. The aim of this study was to compare the accuracy of land cover maps produced by three temporal aggregation methods: median reflectance, maximum normalised difference vegetation index (NDVI), and a two-date image stack using Sentinel-2 (S2) and then to analyse their implications for LM calculation.

View Article and Find Full Text PDF

Burkholderia pseudomallei (Bp), causing melioidosis, is becoming a major global public health concern. It is highly endemic in Southeast Asia (SEA) and Northern Australia and is persisting beyond the established areas of endemicity. This study aimed to determine the environmental variables that would predict the most suitable ecological niche for this pathogenic bacterium in SEA by maximum entropy (MaxEnt) modeling.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!