assessment concepts reliability validity inter-rater test-retest construct content...

31
assessment concepts reliability validity • inter-rater • test-retest • construct • content • concurrent/descriptive • predictive/criterion standardization use of consistent set of standards in procedure for testing, scoring, evaluation

Upload: evan-lucas

Post on 25-Dec-2015

227 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

assessment concepts

reliability

validity

• inter-rater • test-retest

• construct• content• concurrent/descriptive• predictive/criterion

standardizationuse of consistent set of standards in procedure for testing, scoring, evaluation

Page 2: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

clinical interview

mental status exam

1. appearance & behavior

1. thought process

1. mood & affect

1. intellectual functioning

1. sensorium

Page 3: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

semi-structured clinical interview

DSM Multiaxial System

Axis I: Major DisordersAxis II: Personality Disorders & Mental RetardationAxis III: Medical ConditionsAxis IV: Psychosocial & Environmental FactorsAxis V: Global Assessment of Functioning (GAF)

Page 4: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

testing

Projective tests

• Rorschach• Thematic Apperception Test

Page 5: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

testingPersonality Inventories (e.g .MMPI)

Also:Lie Scale Malingering Scale

Page 6: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

testing

Neuropsychological Tests

-tasks are associated with functioning of specific brain areas-poor task performance indicates impaired function (and possibly physical damage) of the specific brain area

Page 7: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

structural vs. functional

CTMRI

PETfMRI

testing

Neuroimaging

Page 8: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

CT scan

• x-ray & sensor• low spatial resolution

computerized axial tomography

Page 9: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

MRI

high spatial resolution

magnetic resonance imaging

Page 10: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

PET scanpositron emission tomography

• low resolution (both temporal & spatial)

• radioactive material is absorbed

Page 11: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

fMRI scan

• higher spatial resolution than PET (poor temporal resolution)

• 3-D images possible

• hemoglobin (blood protein that binds oxygen) changes its magnetic field response

functional MRI

Page 12: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

EEG

psychophysiological techniques

EOG

EMG

“electrophysiology”

= electro-myograph

= electro-oculograph

= electro-encephalograph

Page 13: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

EEGelectroencephalography

record of electrical activity below each electrode

Page 14: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

EEG brainwaves characterize mental states

Page 15: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

EMGelectromyograph

Page 16: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

SCRskin conductance/resistance

index of physiological arousal

Page 17: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

classification

Classification – categoriesTaxonomy – scientific categoriesNosology – psych or medical categories

Classical Categorical ApproachUsed in medicine; discrete categories

Dimensional ApproachCharacteristics range from low to high. Not “presence

or absence” but rather “How much?”

Prototypical ApproachEssential features + meet # symptoms for dx

Page 18: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

types of research

• descriptive

• experimental

-observation (naturalistic vs lab)

-survey

-case study

-correlational studies

-epidemiology

Page 19: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

correlation

Are two variables related?

1. Do they move together or opposite?

2. How strongly?

(if they are strongly related, we can predict one from the other)

Page 20: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

correlation coefficient

POSITIVENEGATIVE NO ASSN

-1.00 0 +1.00

+ / -

number

= direction

= strength

weak (0 - .40)moderate (.41 - .69)strong (.70 – 1.00)

Page 21: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

correlational studies

POSITIVE NEGATIVE NO ASSN

Page 22: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

To a group of people, give a questionnaire about their degree of shyness.

Are shy people happy?

To this same group, give a questionnaire about their degree of happiness.

Each person has two scores. Use correlation.

Is there a relationship between shyness & happiness? (Did one cause the other?)

Page 23: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

correlational studies

Correlation is NOT causation!

A

A

B

B

C

B

A

Page 24: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

example

e.g. Ice cream sales positively correlate with the occurrence of violent crime.

ice cream sales

Variable 1 Variable 2

violent crime

Page 25: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

independentvariable

dependentvariable

experimental research

confoundingvariable

Page 26: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

experimental research

Interested in a specific treatment?

Compare its effects to a control condition.

“baseline” comparison

Page 27: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

internal validity

external validity - generalizability

experimental research

statistical vs clinical significance

Page 28: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

repeated measurements

withdrawal designs

single case designs

multiple baseline

Page 29: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

family studies

adoption studies

twin studies

genetics

genotype

phenotype

Page 30: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

molecular genetic studies

linkage analysis

association study

- searches for approximate location of a gene

- tests a candidate disease gene

Page 31: Assessment concepts reliability validity inter-rater test-retest construct content concurrent/descriptive predictive/criterion standardization use of consistent

behavior over time

prevention studies

cross sectional

-health promotion-universal -selected-indicated

- diff age cohorts compared at same time

longitudinal- one group tracked over time

sequential- cross sectional study done longitudinally