Timing of social feedback shapes observational learning in strategic interaction.

Many types of social interaction require the ability to anticipate others' behavior, which is commonly referred to as strategic sophistication. In this context, observational learning can represent a decisive tool for behavioral adaptation. However, little is known on whether and when individuals learn from observation in interactive settings.

How conformity can lead to polarised social behaviour.

Learning social behaviour of others strongly influences one's own social attitudes. We compare several distinct explanations of this phenomenon, testing their predictions using computational modelling across four experimental conditions. In the experiment, participants chose repeatedly whether to pay for increasing (prosocial) or decreasing (antisocial) the earnings of an unknown other.

An Empirical Test of the Role of Value Certainty in Decision Making.

Most contemporary models of value-based decisions are built on value estimates that are typically self-reported by the decision maker. Such models have been successful in accounting for choice accuracy and response time, and more recently choice confidence. The fundamental driver of such models is choice difficulty, which is almost always defined as the absolute value difference between the subjective value ratings of the options in a choice set.

The differential impact of friendship on cooperative and competitive coordination.

Friendship is commonly assumed to reduce strategic uncertainty and enhance tacit coordination. However, this assumption has never been tested across two opposite poles of coordination involving either strategic complementarity or substitutability. We had participants interact with friends or strangers in two classic coordination games: the stag-hunt game, which exhibits strategic complementarity and may foster "cooperation", and the entry game, which exhibits strategic substitutability and may foster "competition".

The Effect of Counterfactual Information on Outcome Value Coding in Medial Prefrontal and Cingulate Cortex: From an Absolute to a Relative Neural Code.

Adaptive coding of stimuli is well documented in perception, where it supports efficient encoding over a broad range of possible percepts. Recently, a similar neural mechanism has been reported also in value-based decision, where it allows optimal encoding of vast ranges of values in PFC: neuronal response to value depends on the choice context (relative coding), rather than being invariant across contexts (absolute coding). Additionally, value learning is sensitive to the amount of feedback information: providing complete feedback (both obtained and forgone outcomes) instead of partial feedback (only obtained outcome) improves learning.

Gaze data reveal individual differences in relational representation processes.

In our everyday life, we often need to anticipate the potential occurrence of events and their consequences. In this context, the way we represent contingencies can determine our ability to adapt to the environment. However, it is not clear how agents encode and organize available knowledge about the future to react to possible states of the world.

Dissociation between Private and Social Counterfactual Value Signals Following Ventromedial Prefrontal Cortex Damage.

Individuals learn by comparing the outcome of chosen and unchosen actions. A negative counterfactual value signal is generated when this comparison is unfavorable. This can happen in private as well as in social settings-where the foregone outcome results from the choice of another person.

Reference-point centering and range-adaptation enhance human reinforcement learning at the cost of irrational preferences.

In economics and perceptual decision-making contextual effects are well documented, where decision weights are adjusted as a function of the distribution of stimuli. Yet, in reinforcement learning literature whether and how contextual information pertaining to decision states is integrated in learning algorithms has received comparably little attention. Here, we investigate reinforcement learning behavior and its computational substrates in a task where we orthogonally manipulate outcome valence and magnitude, resulting in systematic variations in state-values.

Goal Directed and Self-Control Systems in Bulimia Nervosa: An fMRI Study.

Background: Binge eating is apparently the opposite of the strict control over food intake typically set by "maladaptive dieters". Using functional magnetic resonance imaging (fMRI), we investigated the role of goal-directed behaviors, and the related use of self-control, in binge-related food choices in patients with Bulimia Nervosa (BN).

Method: While undergoing fMRI, women aged 18-35 with BN (N = 35) and healthy control women (N = 26) rated foods for healthiness and tastiness and then made food choices on a 5 points Likert scale between two conflicting options: one food with lower healthiness and higher tastiness (defined as uncontrolled choice) than the other food (defined as controlled choice).

The Role of Intelligence in Social Learning.

Studies in cultural evolution have uncovered many types of social learning strategies that are adaptive in certain environments. The efficiency of these strategies also depends on the individual characteristics of both the observer and the demonstrator. We investigate the relationship between intelligence and the ways social and individual information is utilised to make decisions in an uncertain environment.

"Betting on nature" or "betting on others": anti-coordination induces uniquely high levels of entropy.

Uncertainty in the form of risk or ambiguity can arise from the interaction with nature and other players, while strategic uncertainty arises only in interactions with others. Here, we systematically compare binary decisions between a safe option and a potentially higher paying but uncertain option in four experimental conditions with the same potential monetary outcomes: coordination vs. anti coordination games, as well as risky and ambiguous lotteries.

Neural mechanisms mediating degrees of strategic uncertainty.

In social interactions, strategic uncertainty arises when the outcome of one's choice depends on the choices of others. An important question is whether strategic uncertainty can be resolved by assessing subjective probabilities to the counterparts' behavior, as if playing against nature, and thus transforming the strategic interaction into a risky (individual) situation. By means of functional magnetic resonance imaging with human participants we tested the hypothesis that choices under strategic uncertainty are supported by the neural circuits mediating choices under individual risk and deliberation in social settings (i.

Specific effect of a dopamine partial agonist on counterfactual learning: evidence from Gilles de la Tourette syndrome.

The dopamine partial agonist aripiprazole is increasingly used to treat pathologies for which other antipsychotics are indicated because it displays fewer side effects, such as sedation and depression-like symptoms, than other dopamine receptor antagonists. Previously, we showed that aripiprazole may protect motivational function by preserving reinforcement-related signals used to sustain reward-maximization. However, the effect of aripiprazole on more cognitive facets of human reinforcement learning, such as learning from the forgone outcomes of alternative courses of action (i.

The Sequential Binge, a New Therapeutic Approach for Binge Eating: A Pilot Study.

Background And Objectives: A sizeable proportion of patients experiencing binge eating do not respond to cognitive behavioral therapy (CBT). We present the sequential binge (SB), a new behavioral intervention that complements CBT, and preliminary results of its effects. SB breaks up the binge into repeated identical sequences of eating separated by incremental pauses.

The Computational Development of Reinforcement Learning during Adolescence.

Adolescence is a period of life characterised by changes in learning and decision-making. Learning and decision-making do not rely on a unitary system, but instead require the coordination of different cognitive processes that can be mathematically formalised as dissociable computational modules. Here, we aimed to trace the developmental time-course of the computational modules responsible for learning from reward or punishment, and learning from counterfactual feedback.

Preference for Safe Over Risky Options in Binge Eating.

Binge eating has been usually viewed as a loss of control and an impulsive behavior. But, little is known about the actual behavior of binging patients (prevalently women) in terms of basic decision-making under risk or under uncertainty. In healthy women, stressful cues bias behavior for safer options, raising the question of whether food cues that are perceived as threatening by binging patients may modulate patients' behaviors towards safer options.

Different Attentional Patterns for Regret and Disappointment: An Eye-tracking Study.

The unfavorable comparison between the obtained and expected outcomes of our choices may elicit disappointment. When the comparison is made with the outcome of alternative actions, emotions like regret can serve as a learning signal. Previous work showed that both anticipated disappointment and regret influence decisions.

Contextual modulation of value signals in reward and punishment learning.

Compared with reward seeking, punishment avoidance learning is less clearly understood at both the computational and neurobiological levels. Here we demonstrate, using computational modelling and fMRI in humans, that learning option values in a relative--context-dependent--scale offers a simple computational solution for avoidance learning. The context (or state) value sets the reference point to which an outcome should be compared before updating the option value.

The impact of perceived similarity on tacit coordination: propensity for matching and aversion to decoupling choices.

Homophily, or "love for similar others," has been shown to play a fundamental role in the formation of interpersonal ties and social networks. Yet no study has investigated whether perceived similarities can affect tacit coordination. We had 68 participants attempt to maximize real monetary earnings by choosing between a safe but low paying option (that could be obtained with certainty) and a potentially higher paying but "risky" one, which depended on the choice of a matched counterpart.

Cerebellar damage impairs the self-rating of regret feeling in a gambling task.

Anatomical, clinical, and neuroimaging evidence implicates the cerebellum in processing emotions and feelings. Moreover recent studies showed a cerebellar involvement in pathologies such as autism, schizophrenia and alexithymia, in which emotional processing have been found altered. However, cerebellar function in the modulation of emotional responses remains debated.

Improved planning abilities in binge eating.

Objective: The role of planning in binge eating episodes is unknown. We investigated the characteristics of planning associated with food cues in binging patients. We studied planning based on backward reasoning, reasoning that determines a sequence of actions back to front from the final outcome.

Feelings of regret and disappointment in adults with high-functioning autism.

Impairments in emotional processing in Autism Spectrum Disorders (ASDs) can be characterised by failure to generate and recognize self-reflective, cognitive-based emotions, such as pride, embarrassment and shame. Among this type of emotions, regret and disappointment, as well as their positive counterparts, result from a counterfactual comparison, that is the comparison between an actual value ("what is") and a fictive value ("what might have been"). However, while disappointment is experienced when the obtained outcome is worse than the expected outcome that might have occurred from the same choice, regret occurs when one experiences an outcome that is worse than the outcome of foregone choices.

Emotional valence and the free-energy principle.

The free-energy principle has recently been proposed as a unified Bayesian account of perception, learning and action. Despite the inextricable link between emotion and cognition, emotion has not yet been formulated under this framework. A core concept that permeates many perspectives on emotion is valence, which broadly refers to the positive and negative character of emotion or some of its aspects.

Reputational priors magnify striatal responses to violations of trust.

Humans learn to trust each other by evaluating the outcomes of repeated interpersonal interactions. However, available prior information on the reputation of traders may alter the way outcomes affect learning. Our functional magnetic resonance imaging study is the first to allow the direct comparison of interaction-based and prior-based learning.

Multiple sclerosis decreases explicit counterfactual processing and risk taking in decision making.

Introduction: Deficits in decision making (DM) are commonly associated with prefrontal cortical damage, but may occur with multiple sclerosis (MS). There are no data concerning the impact of MS on tasks evaluating DM under explicit risk, where different emotional and cognitive components can be distinguished.

Methods: We assessed 72 relapsing-remitting MS (RRMS) patients with mild to moderate disease and 38 healthy controls in two DM tasks involving risk with explicit rules: (1) The Wheel of Fortune (WOF), which probes the anticipated affects of decisions outcomes on future choices; and (2) The Cambridge Gamble Task (CGT) which measures risk taking.