Ivan Pavlov (1849-1936)

Classical conditioning procedure

S

R

Classical conditioning procedure

US

UR

Classical conditioning procedure

S + US

URR

Classical conditioning procedure

CS + US

CR UR

Stimulus Generalization, stimulus discrimination, extinction

Extinction: how we know it isn’t forgetting

1) Spontaneous Recovery

2) Rapid Reaquisition

3) Disinhibition

Higher Order Learning

Human Applications of Classical Conditioning

1) Money

2) Fear (simple phobias)

3) Drug addiction

4) Advertising

Instrumental Conditioning Foundations

Thorndike’s Puzzle Boxes

Thorndike’s Puzzle Boxes

One cat’s data (all of the others are similar):

Burrhus Frederick Skinner

The Skinner Box

Some basic terminology

R -- Rfer

Response-reinforcer relationship

Positive (presented) Negative (removed)

Positive Rfer

Negative Rfer

positive reinforcement

(reward)

Positive punishment

negative punishment

(omission)

negative reinforcement

(escape)

Consequence:

Why you should never use positive punishment:

Why you should never use positive punishment:

-emotional side-effects

-imitation

-person delivering punishment becomes an aversive CS (leads to escape or avoidance responses)

How to punish effectively:

-should occur for every instance of the behaviour

-no escape from the punishment

-should occur immediately following behaviour

-should not be paired with a positive reinforcer

-alternative response made available

-should be as intense as possible the first time

(not caught)

(bail)

(time to trial)

(TV, concerts)

(skill building, education)

(first offence leniency)

Instrumental extinction

Some initial side-effects with operant extinction:

1) Increase in response frequency

2) Increase in response vigor (force)

3) Increase in response variability

A fourth element: the discriminative stimulus

SD (S+)

S (S-)

R -- 000

Shaping in Four Easy Steps

1) identify the target, current behaviours

2) Construct a list of “successive approximations” to the target

3) Starting with the first item on the list, reinforce until frequency is stable

4) Put the behavior on extinction until next “successive approximation” behavior is performed, return to step 3.

Shaping in Four Easy Steps

1) identify the target, current behaviours

2) Construct a list of “successive approximations” to the target

3) Starting with the first item on the list, reinforce until frequency is stable

4) Put the behavior on extinction until next “successive approximation” behavior is performed, return to step 3.

Cumulative Recorder

Partial Reinforcement Schedules

FR VR

FIVI

Partial Reinforcement Schedules