Control when confidence is costly.

ArXiv

Departments of Electrical and Computer Engineering and Computer Science, Rice University, Houston, TX 77005.

Published: October 2024

We develop a version of stochastic control that accounts for computational costs of inference. Past studies identified efficient coding without control, or efficient control that neglects the cost of synthesizing information. Here we combine these concepts into a framework where agents rationally approximate inference for efficient control. Specifically, we study Linear Quadratic Gaussian (LQG) control with an added internal cost on the relative precision of the posterior probability over the world state. This creates a trade-off: an agent can obtain more utility overall by sacrificing some task performance, if doing so saves enough bits during inference. We discover that the rational strategy that solves the joint inference and control problem goes through phase transitions depending on the task demands, switching from a costly but optimal inference to a family of suboptimal inferences related by rotation transformations, each misestimate the stability of the world. In all cases, the agent moves more to think less. This work provides a foundation for a new type of rational computations that could be used by both brains and machines for efficient but computationally constrained control.

Download full-text PDF

Source
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC11581108PMC

Publication Analysis

Top Keywords

control
8
efficient control
8
inference
5
control confidence
4
confidence costly
4
costly develop
4
develop version
4
version stochastic
4
stochastic control
4
control accounts
4

Similar Publications

Backgrounds And Aims: CD8+T cells are crucially associated with the fight against hepatitis B virus (HBV) infection. CD161 has been shown to express remarkably on HCV-specific CD8+T cells. However, the accurate function of CD161+CD8+T cells in HBV immunity or pathogenesis remains undetermined.

View Article and Find Full Text PDF

We previously documented successful resolution of skeletal and dental disease in the infantile and late-onset murine models of hypophosphatasia (HPP), with a single injection of an adeno-associated serotype 8 vector encoding mineral-targeted TNAP (AAV8-TNAP-D10). Here, we conducted dosing studies in both HPP mouse models. A single escalating dose from 4x108 up to 4x1010 (vg/b) was intramuscularly injected into 4-day-old Alpl-/- mice (an infantile HPP model) and a single dose from 4x106 up to 4x109 (vg/b) was administered to 8-week-old AlplPrx1/Prx1 mice (a late-onset HPP model).

View Article and Find Full Text PDF

Abdominal aortic aneurysm (AAA) is a severe cardiovascular disease (CVD) that is partly attributable to endothelial dysfunction, inflammatory response, and angiogenesis. G protein-coupled receptor 4 (GPR4), a proton-sensitive G protein-coupled receptor that is abundantly expressed in vascular endothelial cells, has been associated with numerous physiological functions. Nevertheless, its potential involvement in the development of AAA remains unexplored.

View Article and Find Full Text PDF

Bisphenol A (BPA), an environmental endocrine disrupting chemical, is one of the most widely used chemicals in the world and is widely distributed in the external environment, specifically in food, water, dust, and soil. BPA exposure is associated with abnormal cognitive behaviors. However, the underlying mechanism remains unclear.

View Article and Find Full Text PDF

[The potentials of virtual reality in pediatric perioperative care].

Orv Hetil

January 2025

2 Semmelweis Egyetem, Általános Orvostudományi Kar, Aneszteziológiai és Perioperatív Betegellátó Intézet Budapest, Üllői út 78/B, 1082 Magyarország.

View Article and Find Full Text PDF

Want AI Summaries of new PubMed Abstracts delivered to your In-box?

Enter search terms and have AI summaries delivered each week - change queries or unsubscribe any time!