prefrontal cortex: delay-related activityski.clps.brown.edu/cogsim/bg_pfc_wm1.pdf · widely...
TRANSCRIPT
![Page 1: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/1.jpg)
Prefro
ntal
Cortex
:Delay
-relatedactiv
ity
Spatial
delay
ed-resp
onse
task;F
unah
ashiet
al,1989
![Page 2: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/2.jpg)
Rem
ember
theSRN?(ch
ap6)
![Page 3: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/3.jpg)
Rem
ember
theSRN?(ch
ap6)
thisisagatin
gnetw
ork:contex
tonly
updated
atdiscrete
timep
oints
![Page 4: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/4.jpg)
Sim
ple
SRN
story
isnotflaw
less
•How
ishidden
→“co
py”functio
nim
plem
ented
biologically
?
•Durin
gsettlin
g,co
ntex
tmustbeactiv
elymain
tained
(ongoinghidden
activity
has
noeffect
oncontex
t).
•Assu
mes
allcontex
tisrelev
ant:What
ifdistractin
ginform
ation
presen
tedin
middle
ofseq
uen
ce?Wan
tto
only
hold
onto
relevan
t
contex
t.
•What
ifwan
tto
hold
onto
more
than
onepiece
ofinform
ationin
WM
atatim
e??Orto
selectively
update
onepart
ofWM
while
contin
uing
torobustly
main
tainothers?
•Andwhat
ifthedecisio
nofwheth
erornotto
update
inform
ation
dep
endsoncu
rrently
intern
alWM
state?
![Page 5: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/5.jpg)
Sch
izophren
ia:Im
paired
PFC/BG
Functio
n
•SZPatien
tshav
edefi
citsin
thesam
ecognitiv
etask
sas
those
seenin
patien
tswith
PFCdam
age.
![Page 6: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/6.jpg)
Sch
izophren
ia:Im
paired
PFC/BG
Functio
n
•SZPatien
tshav
edefi
citsin
thesam
ecognitiv
etask
sas
those
seenin
patien
tswith
PFCdam
age.
•ButPFCpatien
tsdon’thav
edelu
sions,hallu
cinatio
ns,p
sych
osis.
Also
someim
agingstu
dies
show
increase
inPFCactiv
ityin
SZ
(e.g.,M
anoach
,
2003;Calico
ttet
al,2003)
![Page 7: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/7.jpg)
Sch
izophren
ia:Im
paired
PFC/BG
Functio
n
•SZPatien
tshav
edefi
citsin
thesam
ecognitiv
etask
sas
those
seenin
patien
tswith
PFCdam
age.
•ButPFCpatien
tsdon’thav
edelu
sions,hallu
cinatio
ns,p
sych
osis.
Also
someim
agingstu
dies
show
increase
inPFCactiv
ityin
SZ
(e.g.,M
anoach
,
2003;Calico
ttet
al,2003)
•Psych
osis
thoughtto
stemfro
mincreased
DA
inBG
(Wein
berg
er,
O’D
onnell,
Grace,etc)
![Page 8: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/8.jpg)
Sch
izophren
ia:Im
paired
PFC/BG
Functio
n
•SZPatien
tshav
edefi
citsin
thesam
ecognitiv
etask
sas
those
seenin
patien
tswith
PFCdam
age.
•ButPFCpatien
tsdon’thav
edelu
sions,hallu
cinatio
ns,p
sych
osis.
Also
someim
agingstu
dies
show
increase
inPFCactiv
ityin
SZ
(e.g.,M
anoach
,
2003;Calico
ttet
al,2003)
•Psych
osis
thoughtto
stemfro
mincreased
DA
inBG
(Wein
berg
er,
O’D
onnell,
Grace,etc)
•Other
diso
rders
with
BG/DA
dysfu
nctio
nare
associated
with
frontal-lik
ecognitiv
edefi
cits(PD,ad
dictio
n,A
DHD,etc);th
esedefi
cits
correlate
w/DA
inBG
(Muller
etal,2000;R
emyet
al,2000)
![Page 9: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/9.jpg)
Widely
Accep
tedRole
ofPrefro
ntal
Cortex
(PFC)
PFChelp
skeep
usontask
,promotes
cognitiv
eflexibility
via
ability
to
rapidly
switch
state(e.g
.,task
switch
ing):
•Robust
main
tenan
ceofneu
ralactiv
ity(w
orkingmem
ory)
![Page 10: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/10.jpg)
Widely
Accep
tedRole
ofPrefro
ntal
Cortex
(PFC)
PFChelp
skeep
usontask
,promotes
cognitiv
eflexibility
via
ability
to
rapidly
switch
state(e.g
.,task
switch
ing):
•Robust
main
tenan
ceofneu
ralactiv
ity(w
orkingmem
ory)
•Flex
ibility
from
adap
tivegatin
g(via
Basal
Gan
glia,B
G)that
switch
es
betw
eenmain
tenan
cean
drap
idupdatin
g
![Page 11: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/11.jpg)
Widely
Accep
tedRole
ofPrefro
ntal
Cortex
(PFC)
PFChelp
skeep
usontask
,promotes
cognitiv
eflexibility
via
ability
to
rapidly
switch
state(e.g
.,task
switch
ing):
•Robust
main
tenan
ceofneu
ralactiv
ity(w
orkingmem
ory)
•Flex
ibility
from
adap
tivegatin
g(via
Basal
Gan
glia,B
G)that
switch
es
betw
eenmain
tenan
cean
drap
idupdatin
g
•Exten
siveinterco
nnectiv
ity,allo
wingtop-downbiasin
goftask
-relevan
t
info
inother
cortical
/su
bcortical
areas.
Insh
ort,P
FCisthe“cen
tralexecu
tive!”
![Page 12: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/12.jpg)
WorkingMem
ory
Dem
ands:Updatin
g&
Main
tenan
ce
Hoch
reiter&
Sch
midhuber,
1997;Brav
er&
Cohen
,1999;Fran
ket
al,2001
Sensory
Input
Working
Mem
ory
Gating
open
a) Update
My
phone # is371−
9624
371−9624
•Workingmem
ory:robust
main
tenan
ceofinform
ation,b
utmustalso
hav
eab
ilityto
berap
idly
updated
—req
uires
gatin
g.
•You’vegotto
know
when
tohold
’em,k
now
when
tofold
’em.
![Page 13: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/13.jpg)
WorkingMem
ory
Dem
ands:Updatin
g&
Main
tenan
ce
Hoch
reiter&
Sch
midhuber,
1997;Brav
er&
Cohen
,1999;Fran
ket
al,2001
Sensory
Input
Working
Mem
ory
Gating
open
a) Update
closed
Should I
Stay or
Should I
Go..?
b) Maintain
My
phone # is371−
9624
371−9624
371−9624
•Workingmem
ory:robust
main
tenan
ceofinform
ation,b
utmustalso
hav
eab
ilityto
berap
idly
updated
—req
uires
gatin
g.
•You’vegotto
know
when
tohold
’em,k
now
when
tofold
’em.
![Page 14: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/14.jpg)
WorkingMem
ory
Dem
ands:Updatin
g&
Main
tenan
ce
Hoch
reiter&
Sch
midhuber,
1997;Brav
er&
Cohen
,1999;Fran
ket
al,2001
Sensory
Input
Working
Mem
ory
Gating
a) Update
openclosed
Should I
Stay or
Should I
Go..?
b) Maintain
867−5309
Jenny, Igot your # ...
open
371−9624
371−9624
867−5309 ...371−
9624
My
phone # is371−
9624
c) Update: O
OP
S!
•Workingmem
ory:robust
main
tenan
ceofinform
ation,b
utmustalso
hav
eab
ilityto
berap
idly
updated
—req
uires
gatin
g.
•You’vegotto
know
when
tohold
’em,k
now
when
tofold
’em.
![Page 15: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/15.jpg)
Butwhocontro
lsthecontro
ller?
![Page 16: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/16.jpg)
BG
dam
age⇒
defi
citsin
motor,learn
ing,m
otiv
ation,w
orkingmem
ory,co
gnitiv
econtro
l
![Page 17: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/17.jpg)
BG
Model
Exten
sionto
WorkingMem
ory
andAtten
tion
•In
themotordomain
,theBG
selectively
facilitatesonecomman
dwhile
suppressin
gothers
(Mink,1996)
![Page 18: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/18.jpg)
BG
Model
Exten
sionto
WorkingMem
ory
andAtten
tion
•In
themotordomain
,theBG
selectively
facilitatesonecomman
dwhile
suppressin
gothers
(Mink,1996)
•In
parallel
circuits,
theBG
may
reinforce
theupdatin
gofPFCworking
mem
ory
represen
tations(A
lexan
der
etal,1986;F
rank,L
oughry
&O’Reilly,
2001).
![Page 19: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/19.jpg)
BG
Model
Exten
sionto
WorkingMem
ory
andAtten
tion
•In
themotordomain
,theBG
selectively
facilitatesonecomman
dwhile
suppressin
gothers
(Mink,1996)
•In
parallel
circuits,
theBG
may
reinforce
theupdatin
gofPFCworking
mem
ory
represen
tations(A
lexan
der
etal,1986;F
rank,L
oughry
&O’Reilly,
2001).
•Dopam
inein
PFCsu
pports
robust
main
tenan
ceover
time(Lew
is&
O’D
onnell,
2000;Durstew
itz&
Seem
ans,2002)
![Page 20: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/20.jpg)
BG
Model
Exten
sionto
WorkingMem
ory
andAtten
tion
•In
themotordomain
,theBG
selectively
facilitatesonecomman
dwhile
suppressin
gothers
(Mink,1996)
•In
parallel
circuits,
theBG
may
reinforce
theupdatin
gofPFCworking
mem
ory
represen
tations(A
lexan
der
etal,1986;F
rank,L
oughry
&O’Reilly,
2001).
•Dopam
inein
PFCsu
pports
robust
main
tenan
ceover
time(Lew
is&
O’D
onnell,
2000;Durstew
itz&
Seem
ans,2002)
•Phasic
DA
bursts
thoughtto
occu
rfortask
-relevan
t(“p
ositiv
e”)
inform
ation,rein
forcin
gBG
updatin
gsig
nals
(O’Reilly
&Fran
k,2006;F
rank
&O’Reilly,2006).
![Page 21: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/21.jpg)
BG
Model
Exten
sionto
WorkingMem
ory
andAtten
tion
•In
themotordomain
,theBG
selectively
facilitatesonecomman
dwhile
suppressin
gothers
(Mink,1996)
•In
parallel
circuits,
theBG
may
reinforce
theupdatin
gofPFCworking
mem
ory
represen
tations(A
lexan
der
etal,1986;F
rank,L
oughry
&O’Reilly,
2001).
•Dopam
inein
PFCsu
pports
robust
main
tenan
ceover
time(Lew
is&
O’D
onnell,
2000;Durstew
itz&
Seem
ans,2002)
•Phasic
DA
bursts
thoughtto
occu
rfortask
-relevan
t(“p
ositiv
e”)
inform
ation,rein
forcin
gBG
updatin
gsig
nals
(O’Reilly
&Fran
k,2006;F
rank
&O’Reilly,2006).
•Tim
ecourse
ofDA
activity
:main
tenan
cein
PFC,u
pdatin
gthru
BG.
![Page 22: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/22.jpg)
BG
Gatin
gofPFCWorkingMem
ory
/Atten
tion
![Page 23: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/23.jpg)
BG
Disin
hibitio
nofPFC
=Gatin
gofWorkingMem
ory
/Atten
tion
GP
e
excitatoryinhibitorym
odulatory
striatum
IndirectD
irectthalam
us
GP
i
prefrontal cortex
D2
NoGo
SN
c
D1 Go
•Base
state:Thalam
usinhibited
=Gate
isclo
sed
PFCrobustly
main
tainsprio
rstates.
![Page 24: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/24.jpg)
BG
Disin
hibitio
nofPFC
=Gatin
gofWorkingMem
ory
/Atten
tion
GP
e
D2
excitatoryinhibitorym
odulatory
striatum
IndirectD
irectthalam
us
GP
i
D1
prefrontal cortex
Go
NoG
o
SN
c
•Base
state:Thalam
usinhibited
=Gate
isclo
sed
PFCrobustly
main
tainsprio
rstates.
•Striatu
mfires:
Thalam
usdisin
hibited
=Gate
open
edPFCrap
idly
updated
tomain
tainnew
inform
ation.
![Page 25: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/25.jpg)
Parallel
Strip
es=Selectiv
eGatin
g
... PF
C
...
Posterior
Cortex
......thalam
us
Striatum
(matrix)
}G
P (tonic act)
excitatoryinhibitory
{
dis−inhib
PFC/BG
loopsform
indep
enden
tstrip
es=selectiv
egatin
g.
![Page 26: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/26.jpg)
BG
gates
flow:su
perfi
cial→
Deep
PFC
Main
tenan
cevia
Thalam
ocortical
loops,B
Gdisin
hibits
Superfi
cialrefl
ectsinputs
andmain
tenan
ceSep
arateMain
tenan
cevs.OutputPFC/BG
stripes
![Page 27: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/27.jpg)
Multip
lestrip
es,competitio
n
Competitio
nin
striatum/GPbetw
eenMain
tvsOutputan
ddiff
stripes
![Page 28: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/28.jpg)
Exam
ple
Task
:Specifi
cWorkingMem
ory
Dem
ands
Targ
et(R):
1=A-X
2=B-Y
1 L
AX
LR
B L
X LL
B L2
RYtim
e
outer loopinner loops
Mustmain
tainouter
loop(1,2)
while
updatin
ginner
loop(A
,X..).
![Page 29: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/29.jpg)
Exam
ple
Task
:Specifi
cWorkingMem
ory
Dem
ands
Targ
et(R):
1=A-X
2=B-Y
1 L
AX
LR
B L
X LL
B L2
RYtim
e
outer loopinner loops
Mustmain
tainouter
loop(1,2)
while
updatin
ginner
loop(A
,X..).
•R
obustmain
tenan
ce(over
interv
eningstim
uli;o
uter
loop).
![Page 30: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/30.jpg)
Exam
ple
Task
:Specifi
cWorkingMem
ory
Dem
ands
Targ
et(R):
1=A-X
2=B-Y
1 L
AX
LR
B L
X LL
B L2
RYtim
e
outer loopinner loops
Mustmain
tainouter
loop(1,2)
while
updatin
ginner
loop(A
,X..).
•R
obustmain
tenan
ce(over
interv
eningstim
uli;o
uter
loop).
•R
apidan
dselective
updatin
g(keep
1,2while
updatin
gA,X..).
![Page 31: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/31.jpg)
Exam
ple
Task
:Specifi
cWorkingMem
ory
Dem
ands
Targ
et(R):
1=A-X
2=B-Y
1 L
AX
LR
B L
X LL
B L2
RYtim
e
outer loopinner loops
Mustmain
tainouter
loop(1,2)
while
updatin
ginner
loop(A
,X..).
•R
obustmain
tenan
ce(over
interv
eningstim
uli;o
uter
loop).
•R
apidan
dselective
updatin
g(keep
1,2while
updatin
gA,X..).
Man
yreal-w
orld
exam
ples:
languag
e,plan
ning...
![Page 32: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/32.jpg)
PFC/BG
Model
of1-2-A
X(Fran
k,L
oughry
&O’Reilly,
2001)
{
11
a)
![Page 33: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/33.jpg)
FC/BG
Model
of1-2-A
X(Fran
k,L
oughry
&O’Reilly,
2001)
{
11
{
C1
a)b)
C
![Page 34: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/34.jpg)
FC/BG
Model
of1-2-A
X(Fran
k,L
oughry
&O’Reilly,
2001)
{
11
{
C1
{
A1
A
a)b)
c)
C
![Page 35: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/35.jpg)
FC/BG
Model
of1-2-A
X(Fran
k,L
oughry
&O’Reilly,
2001)
{
11
{
C1
{
A1
A
{
X1
AR
a)b)
c)d)
C
![Page 36: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/36.jpg)
ButHow
doBG
“Know”What
toUpdate/
Ignore?
![Page 37: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/37.jpg)
ButHow
doBG
“Know”What
toUpdate/
Ignore?
Correct:
Incorrect:
![Page 38: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/38.jpg)
DA
effectsonBG
Updatin
gOfPFC
DA
Burst:
Increased
Go
DA
Dip:Increased
NoGo
SN
r
Posterior C
ortexF
rontal Cortex
GP
e
D2
−D
1
dorsalstriatum
+ Go
NoG
othalam
usV
A,V
L,MD
SN
c
excitatoryinhibitorym
odulatory
SN
r
Posterior C
ortexF
rontal Cortex
GP
e
D2
−D
1
dorsalstriatum
+ Go
NoG
othalam
usV
A,V
L,MD
SN
c
excitatoryinhibitorym
odulatory
•DA
bursts/
dipsmodulate
Govs.NoGofirin
gan
dlearn
ing.
•Burst
=Excitato
ryD1onGo
Dip
=Release
ofD2inhibitio
nonNoGo
Sam
emech
anism
asin
basic
motorcircu
itry!(Fran
k,05;G
erfen,00)
![Page 39: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/39.jpg)
PFC/BG
Model,L
earns12-A
Xan
dother
WM
tasks
(O’Reilly
&Fran
k,2006)
Hidden
(Posterior
Cortex)
DA
XY
Z
AB
C
12
3
Input
LR
Output
SN
c
SN
rThal
XY
Z
AB
C
12
3
XY
Z
AB
C
12
3
XY
Z
AB
C
12
3
XY
Z
AB
C
12
3
PF
C(C
ontext)
PV
LV(C
ritic)
Striatum
(Gating,
Actor)
Go N
oGoG
o NoG
oG
o NoG
oGo N
oGo
Go N
oGoG
o NoG
oG
o NoG
oGo N
oGo
LVi
LVe
PV
i
PV
e
![Page 40: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/40.jpg)
Phonological
LoopTask
pfc
bg
inputs
1a
go a
s
go
a
s
go
1
a
2b
ba
bc
3c
r ab
ca
bc
ab
c
r2
r3
bc
out Phonological Loop T
askS
tore
Recall
![Page 41: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/41.jpg)
Phonological Loop Task(O’Reilly & Frank, 2006)
PBWM LSTM RBP SRNAlgorithm
0
1000
2000
3000
Epo
chs
to C
riter
ion
Phono Loop Training Time
PBWM LSTM RBP SRNAlgorithm
0
25
50
75
100
Gen
eral
izat
ion
Err
or %
Phono Loop Generalization
PBWM = Prefrontal Basal-ganglia Working Memory; LSTM = Long Short Term Memory
(Schmidhuber et al.); RBP = Recurrent BackPropagation; SRN = Simple Recurrent
Network.
![Page 42: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/42.jpg)
Sim
ulatin
gBG
DA
increases
inSZ:
Effects
on12A
XWorkingMem
ory
Perfo
rman
ce
0 50
100
% Networks Solving Task
IntactS
Z (+
BG
DA
)
12AX
Working M
emory P
erformance
200
250
300
350
400
450
Epochs to Criterion
IntactS
Z (+
BG
DA
)
12AX
Working M
emory P
erformance
Accu
racyTrain
ingNeed
edto
Learn
![Page 43: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/43.jpg)
Eviden
ceforBG
gatin
gofPFC
Instru
ctioncu
esig
nals
wheth
ersu
bseq
uen
tyello
winform
ationis
distractin
g(an
dsh
ould
notbesto
redin
workingmem
ory).
McN
ab&
Klin
gberg
(2008),Natu
reNeu
roscien
ce
![Page 44: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/44.jpg)
Eviden
ceforBG
gatin
gofPFC:L
esionpatien
ts
Baier
etal
(2010),Journal
ofNeu
roscien
ce
![Page 45: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/45.jpg)
Eviden
ceforBG
gatin
gofPFC:N
euroim
aging
Distracto
rversu
sno-distracto
rcontrast:
NoGo!
McN
ab&
Klin
gberg
(2008),Natu
reNeu
roscien
ce
![Page 46: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/46.jpg)
Both
BG
andPFCact
correlate
with
WM
capacity
Better
WM
functio
ncorrelates
with
PFC(m
iddle
frontal
gyrus)
andBG
activity
inDist
vs
NoDist
contrast.
Globuspallid
us=outputofBG;stro
nger
→more
NoGo
McN
ab&
Klin
gberg
(2008),Natu
reNeu
roscien
ce
![Page 47: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/47.jpg)
Eviden
ceforBG
gatin
gofPFC:N
euroim
aging
More
GPactiv
ity⇒
Less
“unnecessary
storag
e”ofdistractin
ginfo
inparietal
cortex
(spatial
storag
e;thisparietal
regionissen
sitiveto
mem
ory
load
).
![Page 48: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/48.jpg)
Eviden
ceforBG
gatin
gofPFC:N
euroim
aging
More
GPactiv
ity⇒
Less
“unnecessary
storag
e”ofdistractin
ginfo
inparietal
cortex
(spatial
storag
e;thisparietal
regionissen
sitiveto
mem
ory
load
).
Nosu
chcorrelatio
nin
PFC,su
ggestin
gthat
BG
=filter
(gate).
McN
ab&
Klin
gberg
(2008),Natu
reNeu
roscien
ce
![Page 49: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/49.jpg)
Testin
gtheModel:
AX-C
PTTask
Cohen
etal
(1997);Barch
etal
(2001);Fran
k&
O’Reilly,2006
X R
BX L
time
ALY
A5
74
•targ
etseq
uen
ceisA
-X;p
ressRbutto
n.
•non-targ
etseq
uen
cesA
-Y,B
-X,B
-Y;p
ressLbutto
n.
•ignore
alldistracto
rs(5,7)
![Page 50: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/50.jpg)
Testin
gtheModel:
AX-C
PTTask
Cohen
etal
(1997);Barch
etal
(2001);Fran
k&
O’Reilly,2006
X R
BX L
time
ALY
A5
74
•targ
etseq
uen
ceisA
-X;p
ressRbutto
n.
•non-targ
etseq
uen
cesA
-Y,B
-X,B
-Y;p
ressLbutto
n.
•ignore
alldistracto
rs(5,7)
•Tests
gatin
gan
dmain
tenan
cecomponen
tsofworkingmem
ory
/atten
tion.
![Page 51: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/51.jpg)
B
![Page 52: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/52.jpg)
X
![Page 53: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/53.jpg)
A
![Page 54: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/54.jpg)
X
![Page 55: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/55.jpg)
A
![Page 56: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/56.jpg)
5
![Page 57: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/57.jpg)
X
![Page 58: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/58.jpg)
A
![Page 59: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/59.jpg)
7
![Page 60: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/60.jpg)
4
![Page 61: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/61.jpg)
Y
![Page 62: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/62.jpg)
A
![Page 63: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/63.jpg)
7
![Page 64: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/64.jpg)
5
![Page 65: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/65.jpg)
X
![Page 66: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/66.jpg)
A
![Page 67: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/67.jpg)
5
![Page 68: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/68.jpg)
7
![Page 69: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/69.jpg)
Y
![Page 70: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/70.jpg)
A
![Page 71: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/71.jpg)
X
![Page 72: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/72.jpg)
B
![Page 73: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/73.jpg)
4
![Page 74: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/74.jpg)
5
![Page 75: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/75.jpg)
4
![Page 76: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/76.jpg)
X
![Page 77: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/77.jpg)
WorkingMem
ory
Dem
ands:AX-C
PTTask
•A-X
target
sequen
ceon70%
oftrials.
•B-Y
iscontro
lconditio
n,notdep
enden
tonworkingmem
ory.
•K
eyconditions:
B-X
,A-Y
![Page 78: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/78.jpg)
B-X:↑Workingmem
ory,
↑perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
open
B Ba) U
pdate B
![Page 79: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/79.jpg)
B-X:↑Workingmem
ory,
↑perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
openclosed
B BB
b) Maintain B
a) Update B
5
![Page 80: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/80.jpg)
B-X:↑Workingmem
ory,
↑perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
openclosed
ResponseM
otor
B BB
b) Maintain B
a) Update B
c) Prepare N
onTarg R
esp.
B
5
![Page 81: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/81.jpg)
B-X:↑Workingmem
ory,
↑perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
openclosed
ResponseM
otor
B BB
b) Maintain B
a) Update B
c) Prepare N
onTarg R
esp.
BX
OK
!
5
![Page 82: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/82.jpg)
B-X:↓Workingmem
ory,
↓perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
open
B Ba) U
pdate B
![Page 83: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/83.jpg)
B-X:↓Workingmem
ory,
↓perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
open
B Ba) U
pdate B
open
b) Update 1
5 5
![Page 84: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/84.jpg)
B-X:↓Workingmem
ory,
↓perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
openR
esponseM
otor
B Ba) U
pdate B
open
b) Update 1
c) No R
elevant Context.
5 55
![Page 85: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/85.jpg)
B-X:↓Workingmem
ory,
↓perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
openR
esponseM
otor
B Ba) U
pdate B
X
open
b) Update 1
c) No R
elevant Context.
OO
PS!
5 55
![Page 86: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/86.jpg)
A-Y:↑Workingmem
ory,
↓perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
open
A AX
a) Update A
![Page 87: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/87.jpg)
A-Y:↑Workingmem
ory,
↓perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
openclosed
A AX
AX
a) Update A
b) Maintain A
5
![Page 88: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/88.jpg)
A-Y:↑Workingmem
ory,
↓perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
openclosed
A AX
AX
Xa) U
pdate A
ResponseM
otor
A c) Prepare T
arg Resp
b) Maintain A
5
![Page 89: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/89.jpg)
A-Y:↑Workingmem
ory,
↓perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
openclosed
A AX
AX
Xa) U
pdate A
ResponseM
otor
Y A c) Prepare T
arg Resp
b) Maintain A
OO
PS!
5
![Page 90: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/90.jpg)
A-Y:↓Workingmem
ory,
↑perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
open
AX
a) Update A
A
![Page 91: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/91.jpg)
A-Y:↓Workingmem
ory,
↑perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
open
AX
a) Update A
A
open
b) Update 1
5 5
![Page 92: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/92.jpg)
A-Y:↓Workingmem
ory,
↑perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
open
AX
a) Update A
ResponseM
otor
c) No R
elevant Context:
A
open
b) Update 1
5 55
![Page 93: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/93.jpg)
A-Y:↓Workingmem
ory,
↑perfo
rman
ce
Sensory
Input
Working
Mem
ory
Gating
open
AX
a) Update A
ResponseM
otor
c) No R
elevant Context:
AY
open
b) Update 1
OK
!5 5
5
![Page 94: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/94.jpg)
WorkingMem
ory
Dem
ands:AX-C
PTTask
•M
oreactive
maintenance
oftask-relevantinfo→
more
A-Y
falsealarm
s,lessB
-Xfalse
alarms
![Page 95: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/95.jpg)
SZ:Im
paired
WorkingMem
ory
Barch
etal
(2001)
Short
Long
Delay
-20
-10 0 10 20
WM Context Index
Controls
Schiz
AX
-CP
T W
orking Mem
ory
•WM
contex
tindex
=BX-AYaccu
racy
![Page 96: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/96.jpg)
Psych
opharm
acological
Studies
Fran
k&
O’Reilly,2006
•Double
blin
d,with
in-su
bjects
desig
n(N
=28).
•Cab
ergolin
ean
dHalo
perid
ol:D2ag
onist
andD2an
tagonist
•D2ag
ents:
preferen
tialactio
nin
BG
(Cam
pset
al,1987;Moghad
dam
&Bunney,1990;
Arnsten
etal.,1994;S
eeman
s&
Yan
g,2004)
![Page 97: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/97.jpg)
Workingmem
ory
gatin
gtask
XR
BX
time
AL
1
3Y
2
AL
LL
LL
LL
Rtime
L
L
LL
LL
LL
A3
23
1X
B4
1
Attentional
Shift
![Page 98: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/98.jpg)
BG
Gatin
gofPFCWorkingMem
ory
Fran
ket
al2001,
O’Reilly
&Fran
k2006,
Hazy
etal
2007...
![Page 99: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/99.jpg)
DA
drugeffects
onworkingmem
ory
gatin
g
seeMoustafa
etal
08an
dFran
ket
al07
forsim
ilardrugeffects
inPark
inson’san
dADHD
![Page 100: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/100.jpg)
Analo
gousdrugeffects
onlearn
ingan
dworkingmem
ory
![Page 101: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/101.jpg)
How
domultip
leBG-FCcircu
itsinteract
inmotiv
atedbeh
avior?
![Page 102: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/102.jpg)
![Page 103: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/103.jpg)
![Page 104: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/104.jpg)
•Only
somemain
tained
PFCrep
srelev
antforprocessin
gdurin
ginterm
ediate
stages
ofprocessin
g
![Page 105: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/105.jpg)
•Red
uces
number
ofS-R
map
pingsneed
edto
belearn
edbymotorcircu
it
![Page 106: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/106.jpg)
•Contex
tual
dep
enden
ciesforoutputgatin
g(e.g
.,arithmetic);
seealso
LSTM
(Hoch
reiter&
Sch
midhuber
97)
![Page 107: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/107.jpg)
![Page 108: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/108.jpg)
Hierarch
icalinteractio
nsam
ongBG-FCcircu
its
•BG
gates
frontal
”actions”
(motor,w
orkingmem
ory,co
ntex
t)
•Anterio
rPFCinfluen
ceposterio
rcircu
itsvia
BG
outputgatin
g
•BG-FCcircu
itslearn
reward
probab
ilitiesvia
DA
pred
ictionerro
rsig
nals
![Page 109: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/109.jpg)
Hierarch
icalinteractio
nsin
BG-FCcircu
its:PFCinfluen
cesonBG
learning
Collin
s&
Fran
k2013,P
sych
Rev
;Fran
k&
Bad
re2012
![Page 110: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/110.jpg)
Broad
ersp
eculatio
ns:
Whydoes
motorcontro
ldev
elopso
slowly
inhuman
s??
•Stan
dard
story:infan
tsborn
earlydueto
largehead
,small
birth
canal
•’Fourth
trimester’
![Page 111: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/111.jpg)
Broad
ersp
eculatio
ns:
Whydoes
motorcontro
ldev
elopso
slowly
inhuman
s??
•Stan
dard
story:infan
tsborn
earlydueto
largehead
,small
birth
canal
•’Fourth
trimester’
•But3month
old
infan
tsstill
pretty
incompeten
t(fro
mbab
ycen
ter.com):
![Page 112: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/112.jpg)
Broad
ersp
eculatio
ns:
Whydoes
motorcontro
ldev
elopso
slowly
inhuman
s??
•Stan
dard
story:infan
tsborn
earlydueto
largehead
,small
birth
canal
•’Fourth
trimester’
•But3month
old
infan
tsstill
pretty
incompeten
t(fro
mbab
ycen
ter.com):
“Youno
longerneed
tosupporthis
head.W
henhe’s
onhis
stoma
ch,hecan
lifthis
headand
chest.H
ecan
openand
closehis
hands..”
![Page 113: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/113.jpg)
Broad
ersp
eculatio
ns:
Whydoes
motorcontro
ldev
elopso
slowly
inhuman
s??
•Stan
dard
story:infan
tsborn
earlydueto
largehead
,small
birth
canal
•’Fourth
trimester’
•But3month
old
infan
tsstill
pretty
incompeten
t(fro
mbab
ycen
ter.com):
“Youno
longerneed
tosupporthis
head.W
henhe’s
onhis
stoma
ch,hecan
lifthis
headand
chest.H
ecan
openand
closehis
hands..”
•Hypothesis:
human
brain
iswired
todisco
ver
gen
eralizable
structu
re....which
isinitially
ineffi
cient.
![Page 114: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/114.jpg)
![Page 115: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/115.jpg)
![Page 116: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/116.jpg)
![Page 117: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/117.jpg)
![Page 118: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/118.jpg)
![Page 119: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/119.jpg)
![Page 120: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/120.jpg)
![Page 121: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/121.jpg)
![Page 122: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/122.jpg)
seealso
Gersh
man
etal
2010
![Page 123: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/123.jpg)
Model
mim
icry:C-TSan
dhierarch
icalBG-PFCnetw
ork
•Sparsen
essofcontex
t-PFCconnectiv
itymatrix
islin
ked
toαclu
stering
•Both
models
areap
proxim
ationsofthesam
eprocess:
build
ingTSstru
cture
•fM
RIev
iden
ceforhierarch
icalPFC-BG
mech
anism
sBad
reet
al2010;
Bad
re&
Fran
k2012
Collin
s&
Fran
k2013
Psych
Rev
![Page 124: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/124.jpg)
![Page 125: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/125.jpg)
Hierarch
icallearn
ingan
dclu
stering:First,in
adults
![Page 126: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/126.jpg)
![Page 127: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/127.jpg)
![Page 128: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/128.jpg)
![Page 129: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/129.jpg)
Clusterin
gaffo
rdsfaster
learningwith
inexistin
grule
sets...
![Page 130: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/130.jpg)
Butinitial
(phase
1)clu
steringisineffi
cientan
dslo
w!
![Page 131: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/131.jpg)
![Page 132: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/132.jpg)
![Page 133: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/133.jpg)
Now,in
Infan
ts!
Werch
anet
al,2015;
inprep
![Page 134: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/134.jpg)
Bad
reHierarch
icalLearn
ingTask
Bad
re,Kay
ser&
D’Esp
osito
,2010
Flat
(conjunctiv
e)Hierarch
ical
![Page 135: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/135.jpg)
Learn
ingCurves
![Page 136: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/136.jpg)
Rostro
-caudal
axisan
dhierarch
icalcontro
l
preP
MD:
•2n
dlev
elofhierarch
icalcontro
l(fro
mBad
re,Koech
lin)
•activ
itypred
ictslearn
ingin
2ndlev
elhier
conditio
n,d
eclines
inflat
conditio
n
![Page 137: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/137.jpg)
Striatu
mim
plicated
inhierarch
icalrule
learning
How
doBG-PFCcircu
itsinteract
todisco
ver
hierarch
icalstru
cture?
![Page 138: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/138.jpg)
Hierarch
icalinteractio
nsam
ongBG-FCcircu
its
![Page 139: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/139.jpg)
Applicatio
nto
Bad
retask
•Anterio
rPFCaffects
posterio
rcircu
itsvia
BG
outputgatin
g
•Red
uces
#ofstim
ulus-resp
onse
map
pingsneed
edto
belearn
edin
motorcircu
it.
![Page 140: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/140.jpg)
Applicatio
nto
Bad
retask
![Page 141: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/141.jpg)
Modelin
gBG-PFChierarch
icallearn
ing
01
23
45
67
8E
poch
20 30 40 50 60 70 80
Percent Error
hier_BG
outhier_noD
Am
odhier_B
Gm
ntnohier
Hierarchical T
ask
0100
200300
Trial
0.2
0.3
0.4
0.5
0.6
0.7
0.8
Normalized Max Activation
Hier preP
MD
Flat preP
MD
Model preP
MD
activity by condition
•DA-based
RLin
gatin
gnetw
orksneed
edforrap
idlearn
ingin
Hier
cond
•Asin
fMRIdata,m
odel
preP
MD
activity
decreases
inFlat
relativeto
Hier
•Thisisdueto
reward
pred
ictionerro
rsig
nals
punish
inggatin
gofpreP
MD
when
no
hierarch
icalstru
cture
exists
(staytuned
)
![Page 142: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/142.jpg)
Modelin
gindividual
learners:
abstract
account
•Neu
ralmodel
mak
esplau
sible
linksto
biology,b
utunsu
itable
for
quan
titativefitsto
individual
subject
beh
avior
•Wedev
eloped
abstract
versio
nofhierarch
icalrule
learningusin
g
Bay
esianmixture
ofexperts
(MoE),m
otiv
atedbyneu
ralmodel
![Page 143: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/143.jpg)
Modelin
gindividual
learners:
abstract
account
•Sep
arateexperts
learnP(Rew|R
esp,Shape),P(Rew|R
esp,Orient),etc..
![Page 144: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/144.jpg)
Modelin
gindividual
learners:
abstract
account
•Sep
arateexperts
learnP(Rew|R
esp,Shape),P(Rew|R
esp,Orient),etc..
•Hierarch
icalexperts
separately
learnstatistics
abouteach
dim
ensio
n
contin
gen
tonacan
didate
higher
order
feature
(cf.preP
MD
contex
tforoutputgatin
g).
![Page 145: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/145.jpg)
Modelin
gindividual
learners:
abstract
account
•Sep
arateexperts
learnP(Rew|R
esp,Shape),P(Rew|R
esp,Orient),etc..
•Hierarch
icalexperts
separately
learnstatistics
abouteach
dim
ensio
n
contin
gen
tonacan
didate
higher
order
feature
(cf.preP
MD
contex
tforoutputgatin
g).
•Cred
itassig
nmen
tmech
anism
learnsprobab
ilitythat
eachexpert
contrib
utes
toobserv
edrew
ards
•Atten
tional
mech
anism
selectsam
ongexperts
based
onlearn
ed
probab
ilityofsu
ccessP(Rew|e)∀e.
![Page 146: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/146.jpg)
P(θr,O
|δ1...δ
n)∝
P(δ1...δ
n|θr,O
)P(θr,O
)
![Page 147: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/147.jpg)
![Page 148: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/148.jpg)
weig
hteach
expert
inproportio
nto
learned
probab
ilityofexpert
success
P(Rew|e)∀e.
![Page 149: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/149.jpg)
![Page 150: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/150.jpg)
![Page 151: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/151.jpg)
![Page 152: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/152.jpg)
![Page 153: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/153.jpg)
•Goal:
infer
latenthypotheses
(attentio
nal
wts)
byobserv
ingseq
uen
ceofresp
onses
&rew
ards,m
axim
izinglik
elihoodofch
oices
with
fewfree
param
sforeach
subject
![Page 154: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/154.jpg)
•Param
s:prio
rsto
attendto
eachdim
ensio
n,to
attendto
conjunctio
ns,to
consid
erhierarch
y.3softm
axslo
pes
(motor,w
ithin
experts,b
etween
flat/
hier).
![Page 155: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/155.jpg)
MoEfits
tohuman
s
![Page 156: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/156.jpg)
Exam
ple
attentio
nal
weig
hts:
MoEfitto
human
50100
150200
250300
3500
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9 1
Trial
Attentional WtsS
ubject118 Hierarchical
50100
150200
250300
3500
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9 1
Trial
Attentional Wts
Subject118 F
lat
![Page 157: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/157.jpg)
![Page 158: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/158.jpg)
MoEfitto
BG-PFCmodel
50100
150200
250300
350400
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9 1
Trial
Attentional Wts
MoE
fit to BG
−P
FC
Net
50100
150200
250300
350400
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9 1
Trial
wH
All N
ets: Attention to H
ierarchy
![Page 159: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/159.jpg)
Individual
differen
cesin
attentio
nto
Hierarch
y
50100
150200
250300
3500
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9 1
Trial
wH
All subjects: A
ttention to Hierarchy
![Page 160: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/160.jpg)
Individual
differen
cesin
attentio
nto
Hierarch
y
50100
150200
250300
3500
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9 1
Trial
wH
All subjects: A
ttention to Hierarchy
Med
iansp
litonAtte
nHvsAtte
nF→
more
preP
MD
inHier
conditio
n
![Page 161: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/161.jpg)
Model-b
asedfM
RI:rew
ardpred
ictionerro
rs
50100
150200
250300
350−
1
−0.8
−0.6
−0.4
−0.2 0
0.2
0.4
0.6
0.8 1
PET
rial
•Rew
ardpred
ictionerro
rstrack
edbyen
tirestriatu
m(cf.
O’D
oherty
etal,
2004)
![Page 162: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/162.jpg)
Pred
ictionerro
rsan
datten
tionto
Hier
vsFlat
experts
![Page 163: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/163.jpg)
PE’spred
ictPPMD
declin
ein
Flat
conditio
n
0100
200300
Trial
0.2
0.3
0.4
0.5
0.6
0.7
0.8
Normalized Max Activation
Hier preP
MD
Flat preP
MD
Model preP
MD
activity by condition
⇒Declin
ein
preP
MD
should
bepred
ictedbysen
sitivity
ofBG
toPE’sasso
ciatedwith
hiearch
icalrule
![Page 164: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/164.jpg)
PE’spred
ictPPMD
declin
ein
Flat
conditio
n
0100
200300
Trial
0.2
0.3
0.4
0.5
0.6
0.7
0.8
Normalized Max Activation
Hier preP
MD
Flat preP
MD
Model preP
MD
activity by condition
⇒Declin
ein
preP
MD
should
bepred
ictedbysen
sitivity
ofBG
toPE’sasso
ciatedwith
hiearch
icalrule
leftcau
date
rightcau
date
![Page 165: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/165.jpg)
Computatio
nal/
Biological
Details
Activ
ationscan
bemain
tained
intw
odifferen
tway
s:
•Recu
rrentexcitatio
n:
•Intrin
sicbistab
ility:selectiv
elyactiv
atedionch
annels.
Problem
with
recurren
t:stro
ngest
activatio
nsat
anypointdeterm
inewhat
ismain
tained
–notnecc.
true:
best stimulus
worst stim
ulus
spikes per second
SN
NM
![Page 166: Prefrontal Cortex: Delay-related activityski.clps.brown.edu/cogsim/BG_PFC_WM1.pdf · Widely Accepted Role of Prefrontal Cortex (PFC) PFC helps keep us on task, promotes cognitive](https://reader036.vdocuments.site/reader036/viewer/2022071006/5fc3186f60ddf10c9a24cdfc/html5/thumbnails/166.jpg)
Computatio
nal/
Biological
Details
Ourproposal:
•Thalam
icdisin
hibitio
nactiv
ateslay
er4FC.
•Converg
ence
oflay
er4an
dcortico
-cortical
2/3projectio
nsoneith
er
2/3or5/
6neu
ronstrig
gers
main
tenan
ceionch
annels.
Other
proposals:
•Thalm
ocortical
loopsthem
selves
driv
emain
tenan
ce
(enoughthalam
icneu
ronsto
specify
what
ismain
tained
?)
•Justrecu
rrentexcitatio
nwith
inFC
(unstab
le,butusefu
lcomplem
entto
ionch
annels).