final project - psychological sciences … · final project meet with me over the next week or so...
TRANSCRIPT
![Page 1: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/1.jpg)
![Page 2: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/2.jpg)
Final Project meet with me over the next week or
so to discuss possibilities
![Page 3: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/3.jpg)
![Page 4: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/4.jpg)
What is Likelihood?
![Page 5: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/5.jpg)
What is Likelihood?
prob(data|parm) probability of some data given the known parameters of some model
L(data|parm) likelihood of known data given particular candidate parameters of the model
know parameters à predict some outcome in future data
observing some data à estimate some parameters that maximize the likelihood of the observed data
![Page 6: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/6.jpg)
imagine an unfair coin that gives heads with probability p=.6 and tails with probability q=1-p=.4
what is the probability of getting x heads on N flips?
Prob(x | p) = Nx
!
"#
$
%& px (1' p)N'x = N!
x!(N ' x)!px (1' p)N'x
Binomial Distribution f(x; p) give the probability of observing x “successes” for a Bernoulli process with probability p
probability of getting any particular combination of x heads and N-x tails
number of ways of getting x heads and N-x tails
![Page 7: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/7.jpg)
imagine we flip a coin 10 times and get 4 heads (N=10, x=4) what is the maximum likelihood estimate of p?
L(x | p) = Prob(x | p) = Nx
!
"#
$
%& px (1' p)N'x = N!
x!(N ' x)!px (1' p)N'x
now, x (and N) are fixed we want to find the value of p that maximizes the likelihood L of the data
![Page 8: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/8.jpg)
Matlab week5.m
![Page 9: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/9.jpg)
imagine we flip a coin 10 times and get 4 heads (N=10, x=4) what is the maximum likelihood estimate of p? USING CALCULUS
L(x | p) = Prob(x | p) = Nx
!
"#
$
%& px (1' p)N'x = N!
x!(N ' x)!px (1' p)N'x
lnL = log Nx
!
"#
$
%&
!
"##
$
%&&+ x ln p+ (N ' x)ln(1' p)
d lnLdp
= x 1p
!
"#
$
%&+ (N ' x) 1
1' p!
"#
$
%&('1) = 0
x(1' p)' (N ' x)p = 0x ' xp' Np+ xp = 0
p = xN
![Page 10: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/10.jpg)
imagine we flip a coin 10 times and get 4 heads (N=10, x=4) what is the maximum likelihood estimate of p? USING CALCULUS
L(x | p) = Prob(x | p) = Nx
!
"#
$
%& px (1' p)N'x = N!
x!(N ' x)!px (1' p)N'x
lnL = log Nx
!
"#
$
%&
!
"##
$
%&&+ x ln p+ (N ' x)ln(1' p)
d lnLdp
= x 1p
!
"#
$
%&+ (N ' x) 1
1' p!
"#
$
%&('1) = 0
x(1' p)' (N ' x)p = 0x ' xp' Np+ xp = 0
p = xN
![Page 11: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/11.jpg)
imagine we flip a coin 10 times and get 4 heads (N=10, x=4) what is the maximum likelihood estimate of p? USING CALCULUS
L(x | p) = Prob(x | p) = Nx
!
"#
$
%& px (1' p)N'x = N!
x!(N ' x)!px (1' p)N'x
lnL = log Nx
!
"#
$
%&
!
"##
$
%&&+ x ln p+ (N ' x)ln(1' p)
d lnLdp
= 0+ x 1p
!
"#
$
%&+ (N ' x) 1
1' p!
"#
$
%&('1) = 0
x(1' p)' (N ' x)p = 0x ' xp' Np+ xp = 0
p = xN
![Page 12: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/12.jpg)
imagine we flip a coin 10 times and get 4 heads (N=10, x=4) what is the maximum likelihood estimate of p? USING CALCULUS
L(x | p) = Prob(x | p) = Nx
!
"#
$
%& px (1' p)N'x = N!
x!(N ' x)!px (1' p)N'x
lnL = log Nx
!
"#
$
%&
!
"##
$
%&&+ x ln p+ (N ' x)ln(1' p)
d lnLdp
= 0+ x 1p
!
"#
$
%&+ (N ' x) 1
1' p!
"#
$
%&('1) = 0
x(1' p)' (N ' x)p = 0x ' xp' Np+ xp = 0
p = xN
![Page 13: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/13.jpg)
Now let’s try finding maximum likelihood parameters for a distribution you’ve never seen before. It’s called the Lamron Distribution:
![Page 14: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/14.jpg)
Prob(x |!," 2 ) = 1" 2#
exp !(x !!)2
2" 2"
#$
%
&'
typically, we would want to know the probability of observing x (actually a range of x) given α and β
Now let’s try finding maximum likelihood parameters for a distribution you’ve never seen before. It’s called the Lamron Distribution:
![Page 15: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/15.jpg)
Prob(x |!," 2 ) = 1" 2#
exp !(x !!)2
2" 2"
#$
%
&'
typically, we would want to know the probability of observing x (actually a range of x) given α and β
let us assume instead that we have some observed data x1,x2,x3…xn and we want to find the maximum likelihood estimates for α and β
Now let’s try finding maximum likelihood parameters for a distribution you’ve never seen before. It’s called the Lamron Distribution:
![Page 16: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/16.jpg)
Prob(x1, x2,... |!,"2 ) = 1
" 2#exp !
(xi !!)2
2" 2"
#$
%
&'
i(
typically, we would want to know the probability of observing x (actually a range of x) given α and β
let us assume instead that we have some observed data x1,x2,x3…xn and we want to find the maximum likelihood estimates for α and β
Now let’s try finding maximum likelihood parameters for a distribution you’ve never seen before. It’s called the Lamron Distribution:
![Page 17: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/17.jpg)
Prob(x1, x2,... |!,"2 ) = 1
" 2#exp !
(xi !!)2
2" 2"
#$
%
&'
i(
typically, we would want to know the probability of observing x (actually a range of x) given α and β
let us assume instead that we have some observed data x1,x2,x3…xn and we want to find the maximum likelihood estimates for α and β
Now let’s try finding maximum likelihood parameters for a distribution you’ve never seen before. It’s called the Lamron Distribution:
in other words, what values of parameters (α and β) make that observed set of data most likely
![Page 18: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/18.jpg)
Matlab week5.m
![Page 19: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/19.jpg)
Of course, this is just the Normal Distribution
Prob(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
![Page 20: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/20.jpg)
Prob(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(µ,! 2; x1x2...xn ) =1
! 2"exp !
(xi !µ)2
2! 2
"
#$
%
&'
i=1
n
(
lnL = ! 12 ln(2" )! ln! !
(xi !µ)2
2! 2
)
*+
,
-.
i=1
n
/
0 lnL0µ
=1! 2 (xi !µ)
i=1
n
/ = 0
µ̂ =xi
i=1
n
/n
0 lnL0!
= !n!+1! 2 (xi !µ)
2
i=1
n
/ = 0
!̂ =(xi !µ)
2
i=1
n
/n
That’s the likelihood of observing one data point x. What about the likelihood of observing x1, x2, x3, …
![Page 21: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/21.jpg)
Prob(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(µ,! 2; x1x2...xn ) =1
! 2"exp !
(xi !µ)2
2! 2
"
#$
%
&'
i=1
n
(
lnL = ! 12 ln(2" )! ln! !
(xi !µ)2
2! 2
)
*+
,
-.
i=1
n
/
0 lnL0µ
=1! 2 (xi !µ)
i=1
n
/ = 0
µ̂ =xi
i=1
n
/n
0 lnL0!
= !n!+1! 2 (xi !µ)
2
i=1
n
/ = 0
!̂ =(xi !µ)
2
i=1
n
/n
Recall that if p(x) is the probability of observing x, and if x1, x2, x3, are independent and identically distributed, then p(x1, x2, x3) = p(x1)p(x2)p(x3)
![Page 22: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/22.jpg)
Prob(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(x1x2...xn |µ,!2 ) = 1
! 2"exp !
(xi !µ)2
2! 2
"
#$
%
&'
i=1
n
(
lnL = ! 12 ln(2" )! ln! !
(xi !µ)2
2! 2
)
*+
,
-.
i=1
n
/
0 lnL0µ
=1! 2 (xi !µ)
i=1
n
/ = 0
µ̂ =xi
i=1
n
/n
0 lnL0!
= !n!+1! 2 (xi !µ)
2
i=1
n
/ = 0
!̂ =(xi !µ)
2
i=1
n
/n
What is lnL?
![Page 23: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/23.jpg)
Prob(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(x1x2...xn |µ,!2 ) = 1
! 2"exp !
(xi !µ)2
2! 2
"
#$
%
&'
i=1
n
(
lnL = ! 12 ln(2" )! ln! !
(xi !µ)2
2! 2
)
*+
,
-.
i=1
n
/
0 lnL0µ
=1! 2 (xi !µ)
i=1
n
/ = 0
µ̂ =xi
i=1
n
/n
0 lnL0!
= !n!+1! 2 (xi !µ)
2
i=1
n
/ = 0
!̂ =(xi !µ)
2
i=1
n
/n
![Page 24: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/24.jpg)
L(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(x1x2...xn |µ,!2 ) = 1
! 2"exp !
(xi !µ)2
2! 2
"
#$
%
&'
i=1
n
(
lnL = ! 12 ln(2" )! ln! !
(xi !µ)2
2! 2
)
*+
,
-.
i=1
n
/
0 lnL0µ
=1! 2 (xi !µ)
i=1
n
/ = 0
µ̂ =xi
i=1
n
/n
0 lnL0!
= !n!+1! 2 (xi !µ)
2
i=1
n
/ = 0
!̂ =(xi !µ)
2
i=1
n
/n
Prob(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
What is the derivative wrt μ?
![Page 25: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/25.jpg)
L(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(x1x2...xn |µ,!2 ) = 1
! 2"exp !
(xi !µ)2
2! 2
"
#$
%
&'
i=1
n
(
lnL = ! 12 ln(2" )! ln! !
(xi !µ)2
2! 2
)
*+
,
-.
i=1
n
/
0 lnL0µ
=1! 2 (xi !µ)
i=1
n
/ = 0
µ̂ =xi
i=1
n
/n
0 lnL0!
= !n!+1! 2 (xi !µ)
2
i=1
n
/ = 0
!̂ =(xi !µ)
2
i=1
n
/n
Prob(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
![Page 26: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/26.jpg)
Prob(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
n
x
xnLn
x
xL
xL
xxxxL
xxL
n
ii
n
ii
n
ii
n
ii
n
i
i
n
i
in
∑
∑
∑
∑
∑
∏
=
=
=
=
=
=
−=
=−+−=∂∂
=
=−=∂∂
⎥⎦
⎤⎢⎣
⎡ −−−−=
⎟⎟⎠
⎞⎜⎜⎝
⎛ −−=
⎟⎟⎠
⎞⎜⎜⎝
⎛ −−=
1
2
1
22
1
12
12
2
21
12
2
212
2
22
)(ˆ
0)(1ln
ˆ
0)(1ln
2)(ln)2ln(ln
2)(exp
21)...;,(
2)(exp
21);,(
µσ
µσσσ
µ
µσµ
σµ
σπ
σµ
πσσµ
σµ
πσσµ
L(µ,! 2; x) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(µ,! 2; x1x2...xn ) =1
! 2"exp !
(xi !µ)2
2! 2
"
#$
%
&'
i=1
n
(
lnL = ! 12 ln(2" )! ln! !
(xi !µ)2
2! 2
)
*+
,
-.
i=1
n
/
0 lnL0µ
=1! 2 (xi !µ)
i=1
n
/ = 0
µ̂ =xi
i=1
n
/n
0 lnL0!
= !n!!122! 3 (xi !µ)
2
i=1
n
/ = 0
!̂ =(xi !µ)
2
i=1
n
/n
What is the derivative wrt σ?
![Page 27: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/27.jpg)
Prob(x |µ,! 2 ) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
n
x
xnLn
x
xL
xL
xxxxL
xxL
n
ii
n
ii
n
ii
n
ii
n
i
i
n
i
in
∑
∑
∑
∑
∑
∏
=
=
=
=
=
=
−=
=−+−=∂∂
=
=−=∂∂
⎥⎦
⎤⎢⎣
⎡ −−−−=
⎟⎟⎠
⎞⎜⎜⎝
⎛ −−=
⎟⎟⎠
⎞⎜⎜⎝
⎛ −−=
1
2
1
22
1
12
12
2
21
12
2
212
2
22
)(ˆ
0)(1ln
ˆ
0)(1ln
2)(ln)2ln(ln
2)(exp
21)...;,(
2)(exp
21);,(
µσ
µσσσ
µ
µσµ
σµ
σπ
σµ
πσσµ
σµ
πσσµ
L(µ,! 2; x) = 1! 2"
exp !(x !µ)2
2! 2
"
#$
%
&'
L(µ,! 2; x1x2...xn ) =1
! 2"exp !
(xi !µ)2
2! 2
"
#$
%
&'
i=1
n
(
lnL = ! 12 ln(2" )! ln! !
(xi !µ)2
2! 2
)
*+
,
-.
i=1
n
/
0 lnL0µ
=1! 2 (xi !µ)
i=1
n
/ = 0
µ̂ =xi
i=1
n
/n
0 lnL0!
= !n!!122! 3 (xi !µ)
2
i=1
n
/ = 0
!̂ =(xi !µ)
2
i=1
n
/n
![Page 28: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/28.jpg)
![Page 29: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/29.jpg)
Consider the Exponential Distribution
A Poisson process is a “memoryless” process that generates random events over time. It’s “memoryless” in the sense that whether an event occurs on the next time instant does not depend on how long ago the last event occurred. Examples: ~ spikes in neurons, radioactive decay The exponential distribution give the distribution of times between events. The Poisson distribution gives you the distribution of the number of events within a given period of time. They’re complementary.
f (t | !) = ! exp(!! " t)
![Page 30: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/30.jpg)
Consider the Exponential Distribution
f(t;λ) tells you the probability of observing an event given the rate λ. We want to figure out the rate λ given some data (t1,t2,…,tn)
f (t | !) = ! exp(!! " t)
L(t | !) = ! exp(!! " t)
L(!;t1, t2,..., tn ) = ! exp(!! " ti )i=1
n
#
L(!;t1, t2,..., tn ) = !n exp(!! ti
i=1
n
$ )
lnL = n ln! !! tii=1
n
$
% lnL%!
=n!! ti
i=1
n
$ = 0
!̂ =n
tii=1
n
$
![Page 31: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/31.jpg)
L(t | !) = ! exp(!! " t)
L(t1, t2,..., tn | !) = ! exp(!! " ti )i=1
n
#
L(t1, t2,..., tn | !) = !n exp(!! ti
i=1
n
$ )
lnL = n ln! !! tii=1
n
$
% lnL%!
=n!! ti
i=1
n
$ = 0
!̂ =n
tii=1
n
$
![Page 32: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/32.jpg)
L(t | !) = ! exp(!! " t)
L(t1, t2,..., tn | !) = ! exp(!! " ti )i=1
n
#
L(t1, t2,..., tn | !) = !n exp(!! ti
i=1
n
$ )
lnL = n ln! !! tii=1
n
$
% lnL%!
=n!! ti
i=1
n
$ = 0
!̂ =n
tii=1
n
$
![Page 33: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/33.jpg)
L(t | !) = ! exp(!! " t)
L(t1, t2,..., tn | !) = ! exp(!! " ti )i=1
n
#
L(t1, t2,..., tn | !) = !n exp(!! ti
i=1
n
$ )
lnL = n ln! !! tii=1
n
$
% lnL%!
=n!! ti
i=1
n
$ = 0
!̂ =n
tii=1
n
$
![Page 34: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/34.jpg)
L(t | !) = ! exp(!! " t)
L(t1, t2,..., tn | !) = ! exp(!! " ti )i=1
n
#
L(t1, t2,..., tn | !) = !n exp(!! ti
i=1
n
$ )
lnL = n ln! !! tii=1
n
$
% lnL%!
=n!! ti
i=1
n
$ = 0
!̂ =n
tii=1
n
$
![Page 35: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/35.jpg)
L(t | !) = ! exp(!! " t)
L(t1, t2,..., tn | !) = ! exp(!! " ti )i=1
n
#
L(t1, t2,..., tn | !) = !n exp(!! ti
i=1
n
$ )
lnL = n ln! !! tii=1
n
$
% lnL%!
=n!! ti
i=1
n
$ = 0
!̂ =n
tii=1
n
$
![Page 36: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/36.jpg)
i.e., the average rate
L(t | !) = ! exp(!! " t)
L(t1, t2,..., tn | !) = ! exp(!! " ti )i=1
n
#
L(t1, t2,..., tn | !) = !n exp(!! ti
i=1
n
$ )
lnL = n ln! !! tii=1
n
$
% lnL%!
=n!! ti
i=1
n
$ = 0
!̂ =n
tii=1
n
$
![Page 37: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/37.jpg)
![Page 38: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/38.jpg)
Think about a categorization (or identification) experiment
stimulus Si is categorized with response A or B
What is the data?
27 13 S1
A B
22 18 S2
.
.
.
8 32 Sk
what’s the likelihood of parameters of the GCM given this data?
![Page 39: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/39.jpg)
L( fA|S1, fB|S1, fA|S2, fB|S2,..., fA|Sk, fB|Sk | parameters) =
L( fA|Si, fB|Si | parameters)i
k
! =
NSi
fA|Si
"
#
$$
%
&
''
i
k
! pA|SifA|Si (1( pA|Si )
NSi( fA|Si =
fA|Si + fB|SifA|Si fB|Si
"
#
$$
%
&
''
i
k
! pA|SifA|Si pB|Si
fB|Si
![Page 40: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/40.jpg)
Think about a categorization (or identification) experiment
stimulus Si is categorized with response A, B, or C stimulus Si identified with response associated with stimulus 1, 2, …, n
What is the data?
34 13 3 Si
A B C
when presented with Si, there are 3 possible discrete outcomes – calling it A, B, or C
![Page 41: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/41.jpg)
34 13 3 Si
A B C
when presented with Si, there are 3 possible discrete outcomes – calling it A, B, or C
Imagine that we knew perfectly the mechanism that was driving people’s categorization responses. This mechanism specifies p(A|Si), p(B|Si), and p(C|Si). If we had N=50 presentations of stimulus Si, we could figure out the probability of observed xA=34 A responses, xB=13 B responses, and xC=3 C responses.
Prob(xA, xB, xC; p(A|Si )p(B|Si )p(C|Si ) ) =N
xA xB xC
!
"##
$
%&& p(A|Si )
xA p(B|Si )xB p(C|Si )
xC
![Page 42: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/42.jpg)
34 13 3 Si
A B C
when presented with Si, there are 3 possible discrete outcomes – calling it A, B, or C
Imagine that we knew perfectly the mechanism that was driving people’s categorization responses. This mechanism specifies p(A|Si), p(B|Si), and p(C|Si). If we had N=50 presentations of stimulus Si, we could figure out the probability of observed xA=34 A responses, xB=13 B responses, and xC=3 C responses. But we don’t know the model – that’s what we want to discover. But we do know the data.
![Page 43: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/43.jpg)
34 13 3 Si
A B C
Prob(xA, xB, xC | p(A|Si )p(B|Si )p(C|Si ) ) =N
xA xB xC
!
"##
$
%&& p(A|Si )
xA p(B|Si )xB p(C|Si )
xC
L(xA, xB, xC | p(A|Si )p(B|Si )p(C|Si ) ) =N
xA xB xC
!
"##
$
%&& p(A|Si )
xA p(B|Si )xB p(C|Si )
xC
where do these probabilities come from? they’re from the model we’re trying to test
![Page 44: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/44.jpg)
34 13 3 Si
A B C
∑ ∑
∑
∈ ∈
∈
+=
Aj BjijBijA
AjijA
i sbsb
sbSAP )|( ⎟
⎠
⎞⎜⎝
⎛−−= ∑
mmmmij jiwcs exp
Prob(xA, xB, xC | p(A|Si )p(B|Si )p(C|Si ) ) =N
xA xB xC
!
"##
$
%&& p(A|Si )
xA p(B|Si )xB p(C|Si )
xC
L(xA, xB, xC | p(A|Si )p(B|Si )p(C|Si ) ) =N
xA xB xC
!
"##
$
%&& p(A|Si )
xA p(B|Si )xB p(C|Si )
xC
![Page 45: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/45.jpg)
34 13 3 Si
A B C
∑ ∑
∑
∈ ∈
∈
+=
Aj BjijBijA
AjijA
i sbsb
sbSAP )|( ⎟
⎠
⎞⎜⎝
⎛−−= ∑
mmmmij jiwcs exp
Prob(xA, xB, xC | p(A|Si )p(B|Si )p(C|Si ) ) =N
xA xB xC
!
"##
$
%&& p(A|Si )
xA p(B|Si )xB p(C|Si )
xC
L(xA, xB, xC | p(A|Si )p(B|Si )p(C|Si ) ) =N
xA xB xC
!
"##
$
%&& p(A|Si )
xA p(B|Si )xB p(C|Si )
xC
![Page 46: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/46.jpg)
34 13 3 Si
A B C
∑ ∑
∑
∈ ∈
∈
+=
Aj BjijBijA
AjijA
i sbsb
sbSAP )|( ⎟
⎠
⎞⎜⎝
⎛−−= ∑
mmmmij jiwcs exp
L(xA, xB, xC | bA,bB,bC,c,w1,w2 ) =N
xA xB xC
!
"##
$
%&& p(A|Si )
xA p(B|Si )xB p(C|Si )
xC
Prob(xA, xB, xC | p(A|Si )p(B|Si )p(C|Si ) ) =N
xA xB xC
!
"##
$
%&& p(A|Si )
xA p(B|Si )xB p(C|Si )
xC
![Page 47: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/47.jpg)
34 13 3 S1
A B C
34 13 3 S2
34 13 3 Sn
L(data | bA,bB,bC,c,w1,w2 ) =Ni
xiA xiB xiC
!
"
##
$
%
&& p(A|Si )
xiA p(B|Si )xiB p(C|Si )
xiC
i=1
n
'
![Page 48: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/48.jpg)
34 13 3 S1
A B C
34 13 3 S2
34 13 3 Sn
∑ ∑∑ ∑∑+−=i i j i j
ijijiji SRPxxNL )|(ln!ln!lnln
![Page 49: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/49.jpg)
![Page 50: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/50.jpg)
Wichmann & Hill fitting psychometric functions (supplemental reading)
![Page 51: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/51.jpg)
motion coherence
accu
racy
are the dots moving right or left?
![Page 52: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/52.jpg)
Psychophysical functions fitting them using maximum likelihood methods
![Page 53: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/53.jpg)
Imagine a Psychophysical Experiment
motion coherence
accu
racy
![Page 54: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/54.jpg)
Why would you fit a Psychophysical Experiment
motion coherence
accu
racy
75%
what level of motion coherence gives 75%
![Page 55: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/55.jpg)
Why would you fit a Psychophysical Experiment
motion coherence
accu
racy
what is the slope of the psychometric function at 75% (or 50% for some applications)?
![Page 56: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/56.jpg)
motion coherence ac
cura
cy
motion coherence
accu
racy
Why would you fit a Psychophysical Experiment
luminance #1
luminance #2
luminance #1
luminance #2
![Page 57: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/57.jpg)
How would you do it using maximum likelihoods?
motion coherence
accu
racy
![Page 58: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/58.jpg)
motion coherence
accu
racy
L(data | params) =Ni
ni,COR ni,INC
!
"
##
$
%
&&p(COR|Si )ni,COR p(INC|Si )
ni,INC
i=1
m
'
![Page 59: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/59.jpg)
motion coherence
accu
racy
L(data | params) =Ni
ni,COR ni,INC
!
"
##
$
%
&&p(COR|Si )ni,COR p(INC|Si )
ni,INC
i=1
m
'
what function defines these?
![Page 60: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/60.jpg)
L(data |!,",#,$) =Ni
ni,COR ni,INC
!
"
##
$
%
&&p(COR|Si )ni,COR p(INC|Si )
ni,INC
i=1
m
'
L(data |!,",#,$) =Ni
ni,COR Ni ( ni,COR
!
"
##
$
%
&&p(COR|Si )i,nCOR (1( p(COR|Si ) )
Ni(ni,COR
i=1
m
'
p(COR|Si ) =%(x;!,",#,$) = # + (1($ (# )F(x;!,")
![Page 61: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/61.jpg)
L(data |!,",#,$) =Ni
ni,COR ni,INC
!
"
##
$
%
&&p(COR|Si )ni,COR p(INC|Si )
ni,INC
i=1
m
'
L(data |!,",#,$) =Ni
ni,COR Ni ( ni,COR
!
"
##
$
%
&&p(COR|Si )i,nCOR (1( p(COR|Si ) )
Ni(ni,COR
i=1
m
'
p(COR|Si ) =%(x;!,",#,$) = # + (1($ (# )F(x;!,")
F(x;!,") =1( exp(((x / ")! )
F(x;!,") = 11+ exp(((x (!) / ")
F(x;!,") = 121+ erf x (!
" 2
!
"#
$
%&
!
"##
$
%&&
F(x;!,") =1( exp((exp((x (!) / "))
Weibull
Logistic
Normal
Gumbel
![Page 62: Final Project - Psychological Sciences … · Final Project meet with me over the next week or so to discuss possibilities](https://reader033.vdocuments.site/reader033/viewer/2022050610/5fb1a18d01e7a31f0f650299/html5/thumbnails/62.jpg)
see week5_psychometric_function.m