BLUE
OC
Olivier Codol
@oliviercodol.bsky.social
Post-doc in RL, motor control, neuroscience at Mila & U de MontrƩal in the Lajoie & Perich labs
95 followers59 following26 posts
OColiviercodol.bsky.social

Sure! Thanks for checking beforehand, appreciate it :)

0
OColiviercodol.bsky.social

First thing that sprang into my mind when I heard of this prize. Iā€™m sure the Nobel committee has people investigating the true contribution of candidates with cross interviews and such but this is still awkward PR that fuels the unfortunate ā€œlone geniusā€ myth of science

0
OColiviercodol.bsky.social

The objective function itself is something I tried to steer away from, which is why it is identical in my models, to fix it so as to abstract it away from the conclusions I agree the ā€œintuitionā€ has limits, even a baby moves with purpose eventually, but learning continues!

2
Reposted by Olivier Codol
MPmattperich.bsky.social
OColiviercodol.bsky.social

We close up by discussing some of our views on learning and plasticity in cortical structures in the brain. Happy to chat more with anyone thinking about these questions!

1
OColiviercodol.bsky.social

Finally, we show that the neural representations produced by RL have stabilization properties when fine-tuning to new environmental dynamics. Unlike supervised learning, this leads to representational reorganization that mirrors cortical plasticity in monkeys.

1
OColiviercodol.bsky.social

We tested these results in a biomechanically simplified setting & found that this completely breaks down, underlining that these different neural "solutions" actually depend on a more complex output-state maps. This sheds a new light on the idea of "universal solutions" for neural networks.

1
OColiviercodol.bsky.social

We found that models trained with RL aligned much better to monkey data in an matched reaching task. This was true with a crude geometrical metric (CCA) and dynamics metric (DSA) over tasks/datasets, and monkeys.

1
OC
Olivier Codol
@oliviercodol.bsky.social
Post-doc in RL, motor control, neuroscience at Mila & U de MontrƩal in the Lajoie & Perich labs
95 followers59 following26 posts