Exact and Soft Successive Refinement of the Information Bottleneck.

The information bottleneck (IB) framework formalises the essential requirement for efficient information processing systems to achieve an optimal balance between the complexity of their representation and the amount of information extracted about relevant features. However, since the representation complexity affordable by real-world systems may vary in time, the processing cost of updating the representations should also be taken into account. A crucial question is thus the extent to which adaptive systems can , which target the same relevant features but at a different granularity.

Emergence of common concepts, symmetries and conformity in agent groups-an information-theoretic model.

The paper studies principles behind structured, especially symmetric, representations through enforced inter-agent conformity. For this, we consider agents in a simple environment who extract individual representations of this environment through an information maximization principle. The representations obtained by different agents differ in general to some extent from each other.

Skilled motor control of an inverted pendulum implies low entropy of states but high entropy of actions.

The mastery of skills, such as balancing an inverted pendulum, implies a very accurate control of movements to achieve the task goals. Traditional accounts of skilled action control that focus on either routinization or perceptual control make opposite predictions about the ways we achieve mastery. The notion of routinization emphasizes the decrease of the variance of our actions, whereas the notion of perceptual control emphasizes the decrease of the variance of the states we visit, but not of the actions we execute.

A space of goals: the cognitive geometry of informationally bounded agents.

Traditionally, Euclidean geometry is treated by scientists as and objective. However, when we take the position of an agent, the problem of selecting a best route should also factor in the abilities of the agent, its embodiment and particularly its cognitive effort. In this paper, we consider geometry in terms of travel between states within a world by incorporating information processing costs with the appropriate spatial distances.

Embodiment and Its Influence on Informational Costs of Decision Density-Atomic Actions vs. Scripted Sequences.

The importance of embodiment for effective robot performance has been postulated for a long time. Despite this, only relatively recently concrete quantitative models were put forward to characterize the advantages provided by a well-chosen embodiment. We here use one of these models, based on the concept of relevant information, to identify in a minimalistic scenario how and when embodiment affects the decision density.

Space Emerges from What We Know-Spatial Categorisations Induced by Information Constraints.

Seeking goals carried out by agents with a level of competency requires an "understanding" of the structure of their world. While abstract formal descriptions of a world structure in terms of geometric axioms can be formulated in principle, it is not likely that this is the representation that is actually employed by biological organisms or that should be used by biologically plausible models. Instead, we operate by the assumption that biological organisms are constrained in their information processing capacities, which in the past has led to a number of insightful hypotheses and models for biologically plausible behaviour generation.

Tilting Together: An Information-Theoretic Characterization of Behavioral Roles in Rhythmic Dyadic Interaction.

Every joint collaborative physical activity performed by a group of people, e.g., carrying a table, typically leads to the emergence of spatiotemporal coordination of individual motor behavior.

Measuring Time with Minimal Clocks.

Being able to measure time, whether directly or indirectly, is a significant advantage for an organism. It allows for timely reaction to regular or predicted events, reducing the pressure for fast processing of sensory input. Thus, clocks are ubiquitous in biology.

Expanding the Active Inference Landscape: More Intrinsic Motivations in the Perception-Action Loop.

Active inference is an ambitious theory that treats perception, inference, and action selection of autonomous agents under the heading of a single principle. It suggests biologically plausible explanations for many cognitive phenomena, including consciousness. In active inference, action selection is driven by an objective function that evaluates possible future actions with respect to current, inferred beliefs about the world.

Cooperation and antagonism in information exchange in a growth scenario with two species.

We consider a simple information-theoretic model of communication, in which two species of bacteria have the option of exchanging information about their environment, thereby improving their chances of survival. For this purpose, we model a system consisting of two species whose dynamics in the world are modelled by a bet-hedging strategy. It is well known that such models lend themselves to elegant information-theoretical interpretations by relating their respective long-term growth rate to the information the individual species has about its environment.

An Informational Study of the Evolution of Codes and of Emerging Concepts in Populations of Agents.

We consider the problem of the evolution of a code within a structured population of agents. The agents try to maximize their information about their environment by acquiring information from the outputs of other agents in the population. A naive use of information-theoretic methods would assume that every agent knows how to interpret the information offered by other agents.

Zipf's Law: Balancing Signal Usage Cost and Communication Efficiency.

We propose a model that explains the reliable emergence of power laws (e.g., Zipf's law) during the development of different human languages.

Bivariate measure of redundant information.

We define a measure of redundant information based on projections in the space of probability distributions. Redundant information between random variables is information that is shared between those variables. But, in contrast to mutual information, redundant information denotes information that is shared about the outcome of a third variable.

Perception-action loops of multiple agents: informational aspects and the impact of coordination.

Embodied agents can be conceived as entities perceiving and acting upon an external environment. Probabilistic models of this perception-action loop have paved the way to the investigation of information-theoretic aspects of embodied cognition. This formalism allows (i) to identify information flows and their limits under various scenarios and constraints, and (ii) to use informational quantities in order to induce the self-organization of the agent's behavior without any externally specified drives.

Generation of tactile maps for artificial skin.

Prior research has shown that representations of retinal surfaces can be learned from the intrinsic structure of visual sensory data in neural simulations, in robots, as well as by animals. Furthermore, representations of cochlear (frequency) surfaces can be learned from auditory data in neural simulations. Advances in hardware technology have allowed the development of artificial skin for robots, realising a new sensory modality which differs in important respects from vision and audition in its sensorimotor characteristics.

Stigmergic gene transfer and emergence of universal coding.

We consider a simple information-theoretic model for evolutionary dynamics approaching the "coding threshold," where the capacity to symbolically represent nucleic acid sequences emerges in response to a change in environmental conditions. We study the conditions when a coupling between the dynamics of a "proto-cell" and its proto-symbolic representation becomes beneficial in terms of preserving the proto-cell's information in a noisy environment. In particular, we are interested in understanding the behavior at the "error threshold" level, which, in our case, turns out to be a whole "error interval.

Information: currency of life?

In biology, the exception is mostly the rule, and the rule is mostly the exception. However, recent results indicate that known universal concepts in biology such as the genetic code or the utilization of ATP as a source of energy may be complemented by a large class of principles based on Shannon's concept of information. The present position paper discusses various promising pathways toward the formulation of such generic informational principles and their relevance for the realm of biology.

Keep your options open: an information-based driving principle for sensorimotor systems.

The central resource processed by the sensorimotor system of an organism is information. We propose an information-based quantity that allows one to characterize the efficiency of the perception-action loop of an abstract organism model. It measures the potential of the organism to imprint information on the environment via its actuators in a way that can be recaptured by its sensors, essentially quantifying the options available and visible to the organism.

Representations of space and time in the maximization of information flow in the perception-action loop.

Sensor evolution in nature aims at improving the acquisition of information from the environment and is intimately related with selection pressure toward adaptivity and robustness. Our work in the area indicates that information theory can be applied to the perception-action loop. This letter studies the perception-action loop of agents, which is modeled as a causal Bayesian network.

Bioinformatic principles underlying the information content of transcription factor binding sites.

Empirically, it has been observed in several cases that the information content of transcription factor binding site sequences (R(sequence)) approximately equals the information content of binding site positions (R(frequency)). A general framework for formal models of transcription factors and binding sites is developed to address this issue. Measures for information content in transcription factor binding sites are revisited and theoretic analyses are compared on this basis.