Although instantaneous interactions are unphysical, a large variety of maximum entropy statistical inference methods match the model-inferred and the empirically measured equal-time correlation functions. Focusing on collective motion of active units, this constraint is reasonable when the interaction timescale is much faster than that of the interacting units, as in starling flocks, yet it fails in a number of counterexamples, as in leukocyte coordination (where signaling proteins diffuse among two cells). Here, we relax this assumption and develop a path integral approach to maximum-entropy framework, which includes delay in signaling.
View Article and Find Full Text PDFThe dreaming Hopfield model constitutes a generalization of the Hebbian paradigm for neural networks, that is able to perform on-line learning when "awake" and also to account for off-line "sleeping" mechanisms. The latter have been shown to enhance storing in such a way that, in the long sleep-time limit, this model can reach the maximal storage capacity achievable by networks equipped with symmetric pairwise interactions. In this paper, we inspect the minimal amount of information that must be supplied to such a network to guarantee a successful generalization, and we test it both on random synthetic and on standard structured datasets (i.
View Article and Find Full Text PDFHebb's learning traces its origin in Pavlov's classical conditioning; however, while the former has been extensively modeled in the past decades (e.g., by the Hopfield model and countless variations on theme), as for the latter, modeling has remained largely unaddressed so far.
View Article and Find Full Text PDFProc Natl Acad Sci U S A
March 2023
A crucial challenge in medicine is choosing which drug (or combination) will be the most advantageous for a particular patient. Usually, drug response rates differ substantially, and the reasons for this response unpredictability remain ambiguous. Consequently, it is central to classify features that contribute to the observed drug response variability.
View Article and Find Full Text PDFThe homeostatic control of their environment is an essential task of living cells. It has been hypothesized that, when microenvironmental pH inhomogeneities are induced by high cellular metabolic activity, diffusing protons act as signaling molecules, driving the establishment of exchange networks sustained by the cell-to-cell shuttling of overflow products such as lactate. Despite their fundamental role, the extent and dynamics of such networks is largely unknown due to the lack of methods in single-cell flux analysis.
View Article and Find Full Text PDFIEEE Trans Neural Netw Learn Syst
June 2022
Inspired by a formal equivalence between the Hopfield model and restricted Boltzmann machines (RBMs), we design a Boltzmann machine, referred to as the dreaming Boltzmann machine (DBM), which achieves better performances than the standard one. The novelty in our model lies in a precise prescription for intralayer connections among hidden neurons whose strengths depend on features correlations. We analyze learning and retrieving capabilities in DBMs, both theoretically and numerically, and compare them to the RBM reference.
View Article and Find Full Text PDFpH balance and regulation within organelles are fundamental to cell homeostasis and proliferation. The ability to track pH in cells becomes significantly important to understand these processes in detail. Fluorescent sensors based on micro- and nanoparticles have been applied to measure intracellular pH; however, an accurate methodology to precisely monitor acidification kinetics of organelles in living cells has not been established, limiting the scope of this class of sensors.
View Article and Find Full Text PDFWe consider restricted Boltzmann machine (RBMs) trained over an unstructured dataset made of blurred copies of definite but unavailable "archetypes" and we show that there exists a critical sample size beyond which the RBM can learn archetypes, namely the machine can successfully play as a generative model or as a classifier, according to the operational routine. In general, assessing a critical sample size (possibly in relation to the quality of the dataset) is still an open problem in machine learning. Here, restricting to the random theory, where shallow networks suffice and the "grandmother-cell" scenario is correct, we leverage the formal equivalence between RBMs and Hopfield networks, to obtain a phase diagram for both the neural architectures which highlights regions, in the space of the control parameters (i.
View Article and Find Full Text PDFX-linked lissencephaly with abnormal genitalia (XLAG) and developmental epileptic encephalopathy-1 (DEE1) are caused by mutations in the Aristaless-related homeobox (ARX) gene, which encodes a transcription factor responsible for brain development. It has been unknown whether the phenotypically diverse XLAG and DEE1 phenotypes may converge on shared pathways. To address this question, a label-free quantitative proteomic approach was applied to the neonatal brain of Arx knockout (ArxKO/Y) and knock-in polyalanine (Arx(GCG)7/Y) mice that are respectively models for XLAG and DEE1.
View Article and Find Full Text PDFRestricted Boltzmann machines (RBMs) with a binary visible layer of size N and a Gaussian hidden layer of size P have been proved to be equivalent to a Hopfield neural network (HNN) made of N binary neurons and storing P patterns ξ, as long as the weights w in the former are identified with the patterns. Here we aim to leverage this equivalence to find effective initialisations for weights in the RBM when what is available is a set of noisy examples of each pattern, aiming to translate statistical mechanics background available for HNN to the study of RBM's learning and retrieval abilities. In particular, given a set of definite, structureless patterns we build a sample of blurred examples and prove that the initialisation where w corresponds to the empirical average ξ¯ over the sample is a fixed point under stochastic gradient descent.
View Article and Find Full Text PDFIn this work we apply statistical mechanics tools to infer cardiac pathologies over a sample of M patients whose heart rate variability has been recorded via 24 h Holter device and that are divided in different classes according to their clinical status (providing a repository of labelled data). Considering the set of inter-beat interval sequences [Formula: see text], with [Formula: see text], we estimate their probability distribution [Formula: see text] exploiting the maximum entropy principle. By setting constraints on the first and on the second moment we obtain an effective pairwise [Formula: see text] model, whose parameters are shown to depend on the clinical status of the patient.
View Article and Find Full Text PDFIn this paper we develop statistical algorithms to infer possible cardiac pathologies, based on data collected from 24 h Holter recording over a sample of 2829 labelled patients; labels highlight whether a patient is suffering from cardiac pathologies. In the first part of the work we analyze statistically the heart-beat series associated to each patient and we work them out to get a coarse-grained description of heart variability in terms of 49 markers well established in the reference community. These markers are then used as inputs for a multi-layer feed-forward neural network that we train in order to make it able to classify patients.
View Article and Find Full Text PDFIn this work we develop analytical techniques to investigate a broad class of associative neural networks set in the high-storage regime. These techniques translate the original statistical-mechanical problem into an analytical-mechanical one which implies solving a set of partial differential equations, rather than tackling the canonical probabilistic route. We test the method on the classical Hopfield model - where the cost function includes only two-body interactions (i.
View Article and Find Full Text PDFMigration of cells can be characterized by two prototypical types of motion: individual and collective migration. We propose a statistical inference approach designed to detect the presence of cell-cell interactions that give rise to collective behaviors in cell motility experiments. This inference method has been first successfully tested on synthetic motional data and then applied to two experiments.
View Article and Find Full Text PDFWe consider a three-layer Sejnowski machine and show that features learnt via contrastive divergence have a dual representation as patterns in a dense associative memory of order P=4. The latter is known to be able to Hebbian store an amount of patterns scaling as N^{P-1}, where N denotes the number of constituting binary neurons interacting P wisely. We also prove that, by keeping the dense associative network far from the saturation regime (namely, allowing for a number of patterns scaling only linearly with N, while P>2) such a system is able to perform pattern recognition far below the standard signal-to-noise threshold.
View Article and Find Full Text PDFA disproportional large number of neurodevelopmental disorders (NDDs) is caused by variants in genes encoding transcription factors and chromatin modifiers. However, the functional interactions between the corresponding proteins are only partly known. Here, we show that KDM5C, encoding a H3K4 demethylase, is at the intersection of transcriptional axes under the control of three regulatory proteins ARX, ZNF711 and PHF8.
View Article and Find Full Text PDFThe standard Hopfield model for associative neural networks accounts for biological Hebbian learning and acts as the harmonic oscillator for pattern recognition, however its maximal storage capacity is α∼0.14, far from the theoretical bound for symmetric networks, i.e.
View Article and Find Full Text PDFBackground: In a previous study, we synthesised a new spiroketal derivative, inspired to natural products, that has shown high antiproliferative activity, potent telomerase inhibition and proapoptotic activity on several human cell lines.
Objective: This work focused on the study of in vivo antitumor effect of this synthetic spiroketal on a murine melanoma model. In order to shed additional light on the origin of the antitumor effect, in vitro studies were performed.
Organ-on-a-chip (OoCs) platforms could revolutionize drug discovery and might ultimately become essential tools for precision therapy. Although many single-organ and interconnected systems have been described, the immune system has been comparatively neglected, despite its pervasive role in the body and the trend towards newer therapeutic products (i.e.
View Article and Find Full Text PDFWe propose a modification of the cost function of the Hopfield model whose salient features shine in its Taylor expansion and result in more than pairwise interactions with alternate signs, suggesting a unified framework for handling both with deep learning and network pruning. In our analysis, we heavily rely on the Hamilton-Jacobi correspondence relating the statistical model with a mechanical system. In this picture, our model is nothing but the relativistic extension of the original Hopfield model (whose cost function is a quadratic form in the Mattis magnetization and mimics the non-relativistic counterpart, the so-called classical limit).
View Article and Find Full Text PDFRestricted Boltzmann machines are described by the Gibbs measure of a bipartite spin glass, which in turn can be seen as a generalized Hopfield network. This equivalence allows us to characterize the state of these systems in terms of their retrieval capabilities, both at low and high load, of pure states. We study the paramagnetic-spin glass and the spin glass-retrieval phase transitions, as the pattern (i.
View Article and Find Full Text PDFWe study generalized restricted Boltzmann machines with generic priors for units and weights, interpolating between Boolean and Gaussian variables. We present a complete analysis of the replica symmetric phase diagram of these systems, which can be regarded as generalized Hopfield models. We underline the role of the retrieval phase for both inference and learning processes and we show that retrieval is robust for a large class of weight and unit priors, beyond the standard Hopfield scenario.
View Article and Find Full Text PDFIn this paper we discuss the applicability of numerical descriptors and statistical physics concepts to characterize complex biological systems observed at microscopic level through organ on chip approach. To this end, we employ data collected on a microfluidic platform in which leukocytes can move through suitably built channels toward their target. Leukocyte behavior is recorded by standard time lapse imaging.
View Article and Find Full Text PDFBackground: The laminin alpha 5 gene () plays a master role in the maintenance and function of the extracellular matrix (ECM) in mammalian tissues, which is critical in developmental patterning, stem cell niches, cancer and genetic diseases. Its mutations have never been reported in human disease so far. The aim of this study was to associate the first mutation in gene to a novel multisystem syndrome.
View Article and Find Full Text PDFStatistical mechanics provides an effective framework to investigate information processing in biochemical reactions. Within such framework far-reaching analogies are established among (anti-) cooperative collective behaviors in chemical kinetics, (anti-)ferromagnetic spin models in statistical mechanics and operational amplifiers/flip-flops in cybernetics. The underlying modeling - based on spin systems - has been proved to be accurate for a wide class of systems matching classical (e.
View Article and Find Full Text PDF