![Page 1: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/1.jpg)
Operant Conditioning
![Page 2: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/2.jpg)
Complex Learning
Why do we learn new behaviors? Classical conditioning only deals with reflex
responses that we already possess. Most of our behaviors are voluntary.
Volitional. Stimulated by something in our environment.
![Page 3: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/3.jpg)
Operant Conditioning
Defined as - the form of learning concerned with changes in emitted responses as a function of their consequences.
![Page 4: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/4.jpg)
Origins of Operant Conditioning
Edward Thorndike Instrumental
Conditioning “Law of Effect”
Satisfying outcome Unsatisfactory outcome
![Page 5: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/5.jpg)
Outcomes of Thorndike’s Work
As it declined learning was taking place.
Learning
How Long - the length of time it took the cat to escape from the puzzle box. This change in performance represented a change in behavior from experience.
![Page 6: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/6.jpg)
Question
In Thorndike’s terms, what sort of things give you satisfaction? What things produce dissatisfaction? Why?
![Page 7: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/7.jpg)
Edward Thorndike
His research provided a foundation for the study of “non-reflexive” learning.
He drew a connection between action and its outcomes.
![Page 8: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/8.jpg)
B. F. Skinner
Skinner coined the term “operant”.
Disagreed with the “soft” concepts of Thorndike’s “satisfying” and “unsatisfactory” outcome(s)
![Page 9: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/9.jpg)
B. F. Skinner
Operant Conditioning replaced Thorndike’s term “instrumental learning”
Emitted behavior is now called “operant responses”
Classical conditioning is now called ‘respondent conditioning.
The Skinner Box or “auto-environmental chamber”
![Page 10: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/10.jpg)
Zack Florin '99 using a Skinner box to shape a rat's behavior
Skinner Box in Action
![Page 11: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/11.jpg)
Reinforcment
Primary reinforcers - food, water, shelter. Those innate biological needs.
Secondary reinforcers (Conditioned reinforcers) - something that will provide a primary reinforcer. (money, poker chips etc.)
![Page 12: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/12.jpg)
Primary vs. Secondary
Which of the following are secondary reinforcers: quarters spilling from a slot machine, a winner’s blue ribbon, a piece of candy, an A on an exam, frequent-flyer miles.
![Page 13: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/13.jpg)
Reinforcement
Negative Reinforcer - an aversive stimulus which serves to decrease the probability of the response in the future.
Positive Reinforcer - a stimulus which when applied increases the probability of the response in the future.
![Page 14: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/14.jpg)
Contingencies of Reinforcement
According to Skinner the relationship between a response and a reinforcer is a contingency.
One type of contingency is “reinforcement”
![Page 15: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/15.jpg)
Desired change in behavior
Type of reinforcer Increases response Decrease response
Positive reinforcer POSITIVE REINFORCEMENT
OMISSION(withholding positive reinforcer)
Negative reinforcer NEGATIVE REINFORCEMENT (escape, avoidance)
PUNISHMENT
![Page 16: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/16.jpg)
Shaping
Some learning does not occur in a single event.
A series of successive steps leads to a learned behavior.
Playing the piano, swimming etc.
![Page 17: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/17.jpg)
Applying the Principles
When asked choose the best alternative and explain why. You want your 2-year-old to ask for water with a
word instead of a grunt. Should you give him water when he says “wa-wa” or wait until his pronunciation improves.
![Page 18: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/18.jpg)
Applying the Principles
When asked choose the best alternative and explain why. Your roommate keeps interrupting your studying
even though you have asked her/him to stop. Should you ignore her/him completely or occasionally respond for the sake of good manners?.
![Page 19: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/19.jpg)
Applying the Principles
When asked choose the best alternative and explain why. Your father, who rarely writes to you, has finally
sent a letter. Should you reply quickly or wait a while so he will know how it feels to be ignored?.
![Page 20: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/20.jpg)
Extinction
What happens when the reinforcement stops.
Extinction - in operant conditioning, a drop I responding when reinforcement is discontinued.
![Page 21: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/21.jpg)
![Page 22: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/22.jpg)
Schedules of Reinforcement
Continuous reinforcement - every response is followed by a reinforcer. (FR1 schedule)
Partial reinforcement - a contingency of reinforcement in which every response does not get a reinforcer.
![Page 23: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/23.jpg)
Fixed Interval Schedule
Referred to as FI x - reinforcement contingency defined by the amount of time that must pass since the previous reinforcer.
Based on time. Example: pay checks
![Page 24: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/24.jpg)
Fixed Ratio Schedule
Referred to as FR x - reinforcement contingency defined by the number of responses the organism must make in order to get a reinforcer.
Example: piece work.
![Page 25: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/25.jpg)
Variable Interval Schedule
Referred to as VI x - a reinforcement contingency defined by the average time interval which must elapse since the last reinforcer.
Example: Quality Control
![Page 26: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/26.jpg)
Variable Ratio Schedule
Referred to as VR x - a reinforcement contingency defined in terms of the average number of responses required to receive a reinforcer.
Example: Slot Machine
![Page 27: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/27.jpg)
Non-Contingent Reinforcement
Random “reinforcement”
Development of what Skinner called ‘superstition’ in the pigeon.
![Page 28: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/28.jpg)
Applying Conditioning
We must always keep in mind that all this is done to match the goals of psychology.
Behavior Modification. Mary Cover Jones - the mother of behavior
therapy Controls AversivePositive
![Page 29: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/29.jpg)
Punishment
Most used and most misunderstood
Occurs after the ‘offense’ has taken place.
Requires “contiguity” Encourages avoidance
behaviors.
![Page 30: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/30.jpg)
Negative Reinforcement
![Page 31: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/31.jpg)
Autonomic Conditioning
Neal Miller and Leo DiCara
‘proprioceptive feedback
![Page 32: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/32.jpg)
Biological Constraints
Some unanswered questions: Equipotentiality
premise Ethology Species-specific
behavior Critical period Preparedness
• The premise that principles of conditioning will apply to any response and any species.
The study of the behavior of animals in their natural environment.
Behaviors which are characteristic of all members of a particular species. (instincts)
A period during development where there are optimal periods for learning.
A concept developed by Martin Seligman to describe how physiological structure influences the occurrence of behavior
![Page 33: Operant Conditioning Complex Learning Why do we learn new behaviors? Classical conditioning only deals with reflex responses that we already possess](https://reader033.vdocuments.site/reader033/viewer/2022051619/56649da15503460f94a8dde4/html5/thumbnails/33.jpg)
Biological Constraints
Prepared Unprepared Contraprepared
Degree of biological preparedness
Species-specific behavior
Bait Shyness Classical and operant conditioning
Unlearnable Associations