The remarkable performance of overparameterized deep neural networks (DNNs) must arise from an interplay between network architecture, training algorithms, and structure in the data. To disentangle these three components for supervised learning, we apply a Bayesian picture based on the functions expressed by a DNN. The prior over functions is determined by the network architecture, which we vary by exploiting a transition between ordered and chaotic regimes.
View Article and Find Full Text PDFOptimal decision-making depends on interconnected frontal brain regions, enabling animals to adapt decisions based on internal states, experiences, and contexts. The secondary motor cortex (M2) is key in adaptive behaviors in expert rodents, particularly in encoding decision values guiding complex probabilistic tasks. However, its role in deterministic tasks during initial learning remains uncertain.
View Article and Find Full Text PDFJ Epidemiol Popul Health
October 2024
Background: Infant mortality in French Guiana, a French overseas territory, is 2.7 times greater than in mainland France. Given the importance of better understanding infant mortality we aimed to describe the early & late neonatal, and postneonatal mortality in French Guiana between 2007 and 2022.
View Article and Find Full Text PDFArguments inspired by algorithmic information theory predict an inverse relation between the probability and complexity of output patterns in a wide range of input-output maps. This phenomenon is known as By viewing the parameters of dynamical systems as inputs, and the resulting (digitised) trajectories as outputs, we study simplicity bias in the logistic map, Gauss map, sine map, Bernoulli map, and tent map. We find that the logistic map, Gauss map, and sine map all exhibit simplicity bias upon sampling of map initial values and parameter values, but the Bernoulli map and tent map do not.
View Article and Find Full Text PDFModeling the rate at which adaptive phenotypes appear in a population is a key to predicting evolutionary processes. Given random mutations, should this rate be modeled by a simple Poisson process, or is a more complex dynamics needed? Here we use analytic calculations and simulations of evolving populations on explicit genotype-phenotype maps to show that the introduction of novel phenotypes can be "bursty" or overdispersed. In other words, a novel phenotype either appears multiple times in quick succession or not at all for many generations.
View Article and Find Full Text PDF