Many thanks also to @stepalminteri.bsky.social, @sophiebavard.bsky.social, and @gjocham.bsky.social for being helpful and for promptly answering all the questions I had.

As a side note, I would not interpret our results as showing that relative value learning (or specific forms thereof) does not exist, but rather that it may not be the primary force behind preference biases in such tasks.

We therefore believe that, in the end, repetition may be a more important factor in shaping choice than previously acknowledged.

Of course, the idea of repetition biases is not new in RL, but to our knowledge it has not yet been shown that such a mechanism can sufficiently and consistently account for such preference biases across a range of value-learning tasks.

Conceptually, I think this aligns very well with work on policy compression by @lucylai.bsky.social and @gershbrain.bsky.social and recent work by @annecollins.bsky.social.

Notably even when Q-value differences or objective absolute or relative value differences were absent. Overall, the impact of this repetition mechanism is larger in more complex tasks.

This holds both in standard analyses and in hierarchical Bayesian modeling, and importantly in settings where the two accounts make divergent predictions. We also found that post-task valuation ratings show that participants rated stimuli higher when they had been chosen more often.

I'm wondering, do you use chatgpt or other ai tools at all? Or do you use them in a "critical way"?

@stefankiebel.bsky.social

can you post everything over here? thank you!

Participants enhanced or inhibited their habitual responses based on whether they were congruent or incongruent with goal-directed behavior.
Using drift-diffusion modeling, we found that habitual and goal-directed response tendencies interact on the level of evidence accumulation (drift-rate).

We discovered that the influence of a habit isn’t static, it depends on the number of repetitions of an action sequence.
🧠 Approximately 60% of participants adaptively adjusted their habitual responses according to the task context.

Oh, thank you. It seems it is not working. This one should: www.jneurosci.org/content/43/4...

4/4 However, further research is needed to clarify a causal link.⚡

3/4 Findings suggest that chronic DBS can modulate this cognitive function over time. Results further hint at a role of the human NAcc region in maintaining our preferences over time as stimulation in this motivational hub can reshape preferences believed to rely on this circuit.

2/4 While short-term stability remains, long-term (6 months) reliability is disrupted. Temporal discounting (choosing between near and distant rewards) is relatively stable in humans and extreme patterns of discounting at least correlate with various mental disorders.