neuroanatomy - brain mappingbrainmapping.org/nitp/images/summer2015slides/nitp2015... · 2015. 8....

45
EXPERIMENTAL DESIGN II Martin M. Monti UCLA Psychology NITP 2015

Upload: others

Post on 19-Nov-2020

0 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

EXPERIMENTAL DESIGN IIMartin M. Monti

UCLA Psychology

NITP 2015

Page 2: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

BLOCK DESIGN

From R. Buckner, HBM2001

Page 3: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

SLOW EVENT RELATED DESIGN

From R. Buckner, HBM2001

Page 4: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

SLOW EVENT RELATED EXP OF LANGUAGE

Page 5: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

Randomize condition/stimuli order

Cf. Confounds of blocked designs (Johnson et al., 1997)

From C. Ruff

Page 6: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

From C. Ruff

Blocked designs may trigger expectations and cognitive sets

Pleasant (P)Unpleasant (U)

Event related designs can minimize expectation/strategy

Page 7: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

Randomize condition/stimuli order

Cf. Confounds of blocked designs (Johnson et al., 1997)

Post-hoc classification of trials

e.g. According to subsequent recall (Wagner et al., 1998)

From C. Ruff

Page 8: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

Wagner et al., 1998

fMRI Task: abstract or concrete word?

After scanning: recognition memory test

fMRI Data Analysis: Classify trials as hit (remembered)

and miss (forgotten)

Page 9: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

Wagner et al., 1998

Page 10: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

Randomize condition/stimuli order

Cf. Confounds of blocked designs (Johnson et al., 1997)

Post-hoc classification of trials

e.g. According to subsequent recall (Wagner et al., 1998)

Some events can only be indicated by the subject

(during the experiment)

e.g. Changes in spontaneous perception (Tong et al., 1998)

From C. Ruff

Page 11: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

Tong et al., 1998

Page 12: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

Tong et al., 1998

Page 13: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

Randomize condition/stimuli order

Cf. Confounds of blocked designs (Johnson et al., 1997)

Post-hoc classification of trials

e.g. According to subsequent recall (Wagner et al., 1998)

Some events can only be indicated by the subject

(during the experiment)

e.g. Changes in spontaneous perception (Tong et al., 1998)

Some trials cannot be blocked

e.g. Odd-ball designs (Clark et al., 2000)

From C. Ruff

Page 14: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

Clark et al., 2000

Oddball

Page 15: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

Randomize condition/stimuli order

Cf. Confounds of blocked designs (Johnson et al., 1997)

Post-hoc classification of trials

e.g. According to subsequent recall (Wagner et al., 1998)

Some events can only be indicated by the subject

(during the experiment)

e.g. Changes in spontaneous perception (Tong et al., 1998)

Some trials cannot be blocked

e.g. Odd-ball designs (Clark et al., 2000)

Better model for blocked stimuli too?

e.g. State-item interactions (Chawla et al., 1999)

From C. Ruff

Page 16: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY EVENT RELATED DESIGNS?

“Event” model may capture state-item interactions (with longer SOAs)

“Epoch” model assumes constant neural processes throughout block

U1 U2 U3 P1 P2 P3

P1 P2 P3U1 U2 U3Data

ModelChawla et al., 1999

Page 17: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHAT/WHEN/WHERE IS THE EVENT?

The man returned to his home was happy

Page 18: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

WHY NOT EVENT RELATED DESIGNS?

Blocked designs are statistically more powerful

Some psychological processes are difficult to switch

on/off, better in blocks

e.g., starting and stopping mental imagery

Excessively complicated designs might confuse the

subject

From C. Ruff

Page 19: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

RAPID EVENT RELATED DESIGN

From R. Buckner, HBM2001

Page 20: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

SLOW EVENT RELATED EXP OF LANGUAGE

Page 21: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

FAST EVENT RELATED

More trials, same

experiment length!

But, hemodynamic

response of different

events now overlaps.

→ How to tease apart

which part of the response

comes from which event?

Page 22: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

ASSUMPTION: LINEAR SYSTEM

System = input → output

Neural activity → fMRI signal

A system is linear if it has two features:

1. Scaling

2. Superposition

If a system is linear we can add/subtract

responses coming from contiguous trials

Page 23: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

ASSUMPTION I: SCALING

Page 24: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

Data from Robert Savoy and Kathleen O’Craven (25).

CAN WE ASSUME SCALING (I)?

Page 25: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

Robson et al., 1998

CAN WE ASSUME SCALING (II)?

Page 26: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

ASSUMPTION II: SUPERPOSITION

Page 27: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

CAN WE ASSUME SUPERPOSITION (I)?

Dale and Buckner, Hum. Brain Map., 1997

Page 28: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

CAN WE ASSUME SUPERPOSITION (II)?

Dale and Buckner, Hum. Brain Map., 1997

Page 29: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

CAN WE ASSUME SUPERPOSITION (II)?

Dale and Buckner, Hum. Brain Map., 1997

Page 30: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

CAN WE ASSUME SUPERPOSITION (II)?

Dale and Buckner, Hum. Brain Map., 1997

Page 31: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

CAN WE ASSUME SUPERPOSITION (II)?

Dale and Buckner, Hum. Brain Map., 1997

Page 32: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

CAN WE ASSUME SUPERPOSITION (III)?

EFFECTS OF PRESENTATION RATE

Friston et al., 1998

Page 33: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

Zhang et al., 2008

CAN WE ASSUME SUPERPOSITION (IV)?

EFFECTS OF ISI

Page 34: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

Huettel & McCarthy 2001

DIFFERENT AREA DIFFERENT NON-LINEARITY

Page 35: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

1. Trial order: shuffle things around

With rapid ER-fMRI, it is important that different trial types follow each other equally

Statistical (multicollinearity) & psychological reasons

Early studies used counterbalancing

Must be done to several orders depending upon trial length

Recent studies have used randomization (full/pseudo)

Works fine with large enough # of trials

HOW TO TEASE APART DIFFERENT TRIALS?

Page 36: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

2. ISI Jitter/Randomization

HOW TO TEASE APART DIFFERENT TRIALS?

Page 37: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

2. ISI Jitter/Randomization

HOW TO TEASE APART DIFFERENT TRIALS?

Page 38: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

TEASING APART SEQUENTIAL PROCESSES

D’Esposito et al.

Page 39: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

NESTED/MIXED DESIGNS

Page 40: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

12^])([ˆ

1

)(

1

)(var

1),(

cXXccVar

AvBestimateXce

TTT

EFFICIENCY

A numerical value that captures the relative

ability of a design to detect an effect of

interest.

Say you are interested in the difference

between two tasks, A & B.

Av.Bestimatevar

Av.Bestimatet

Noise

Contrast of interest

Experimental design

Page 41: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

EFFICIENCY: EXAMPLES

X Matrix: Task A, Task B, Mean

Contrasts of interest:

i. Direct comparison [1 -1 0]

ii. Estimation of each effect against baseline [1 0

0], [0 1 0]

Randomize or not?

Event related or block?

Use rest periods in between blocks?

Page 42: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

Design df e(c,X) 1 -1 0 1 0 0 0 1 0

Fix 100-3 0.31 1.35 0.80 0.83

Rdm 100-3 1.32 3.05 4.47 4.84

R

A

N

D

O

M

I

Z

E

D

F

I

X

E

D

Page 43: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

Design df e(c,X) 1 -1 0 1 0 0 0 1 0

Block 100-3 4.80 13.39 15.09 14.84

Rdm 100-3 1.32 3.05 4.47 4.84

R

A

N

D

O

M

I

Z

E

D

B

L

O

C

K

Page 44: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

Design df e(c,X) 1 -1 0 1 0 0 0 1 0

No Rest 80-3 1.00 20.92 2.12 2.09

Rest 160-3 8.46 20.85 28.47 28.45

N

O

R

E

S

T

R

E

S

T

Page 45: Neuroanatomy - brain mappingbrainmapping.org/NITP/images/Summer2015Slides/NITP2015... · 2015. 8. 4. · Title: Neuroanatomy Author: MCube Created Date: 8/4/2015 8:57:29 AM

GOOD PRACTICES

(BUT YOUR EXPERIMENT MAY DIFFER … )

Bigger IS better: more trials, more TRs, more Ss.

ALWAYS counterbalance/randomize/pseudo-randomize your events!

Ask yourself questions:

What's the best design for my cog process of interest?

What's the best design for my task(s)?

What psychological factors might be at play?

What comparison(s) are you interested in?

Maximize efficiency for your contrast(s) of interest, compare multiple

designs, simulate!

Be considerate: For how long do you think you can get good data out

of a volunteer?