� Ivan Pavlov ¡  Russian Physiologist ¡  Studying digestion ¡  Inadvertently “discovered” the concept of

classical conditioning while using dogs in his experiment

�  Involuntary � A type of associative learning � Learning occurs through the association of

stimuli and responses ¡  UCS = unconditioned stimulus

¢  Something that naturally elicits a response ¡  UCR = unconditioned response

¢  A natural (unlearned) response to a UCS ¡  NS = neutral stimulus

¢  Something that does not elicit a response ¡  CS = conditioned stimulus

¢  A learned stimulus ¡  CR = conditioned response

¢  A learned response

What do you do when you see a spider??

What happens when you see a pencil??

� UCS = spider (because it naturally makes you have a response)

� UCR = being scared at the sight of the spider � NS = pencil (because you have no response to

seeing it) � CS = pencil (because you have learned to

associate the sight of the pencil with the spider)

� CR = being scared at the sight of the pencil (because you anticipate seeing the spider)

� GS = generalized stimulus ¡  Stimuli that are close to the CS that elicit the

same CR ¢  Example – being scared at the sight of a pen because it

is similar to a pencil

¡  Also known as generalization

� Discrimination ¡  Being able to differentiate between a CS and

similar stimuli ¢  Example – not being scared of a pen because even

though it is similar to a pencil, you can tell the difference

� Extinction ¡  No longer having a response to a CS

� Spontaneous Recovery ¡  After a period of extinction, you once again have

a CR to a CS

� Shaping ¡  Using classical conditioning to “shape” a

behavior using steps

� Successive Approximations ¡  The steps in shaping

� https://www.youtube.com/watch?v=9hBfnXACsOI

� UCS = ¡  Loud noise

� UCR = ¡  Afraid, crying, scared

� NS = ¡  White rat

� CS= ¡  White rat

� CR = ¡  Afraid of the white rat

� GS = ¡  White, furry objects

� Edward Thorndike ¡  Psychologist ¡  Studying the effect of rewards on desired

behavior ¡  Developed the LAW OF EFFECT

¢  Rewarded behavior is likely to be repeated

� http://www.youtube.com/watch?v=BDujDOLre-8

� B.F. Skinner ¡  Elaborated on Thorndike’s Law of Effect ¡  Believed that humans did not have free will,

rather we operate on rewards and punishments ¡  Utilized the Skinner Box

¢  A contraption used to train pigeons and rats to complete certain behaviors through using rewards and punishments

� http://www.youtube.com/watch?v=I_ctJqjlrHA

� Voluntary � Based on rewarding desired behavior and

punishing undesired behavior

� Positive reinforcement ¡  The addition of something good for doing the

right behavior

� Negative reinforcement ¡  The subtraction of something bad for doing the

right behavior

� Primary reinforcer ¡  Something biologically important, such as food or

water

� Secondary reinforcer ¡  Something neutral that is associated with

something good, such as a gold star or a homework pass

� Generalized reinforcer ¡  Something that can be associated with different

reinforcers, such as money

� Continuous ¡  Reinforce every time the desired behavior is

done

� Intermittent ¡  Reinforce on a schedule

¢  Fixed ratio – reinforced after a specific number of responses

¢  Fixed interval – reinforced after a specific length of time

¢  Variable ratio – reinforced after a random number of responses

¢  Variable interval – reinforced after a random length of time

� Positive punishment ¡  The addition of something bad due to undesired

behavior

� Negative punishment ¡  Also known as omission training ¡  Taking away something good for undesired

behavior

� If you want to train a person or an animal to complete a complex behavior, you must use small, successive approximations in training.

� Shaping is when you start small and build on learning.

� Albert Bandura ¡  Believed that humans DO think when learning ¡  Conducted the Bobo Doll experiment

¢  He believed that children can learn from watching others

¢  http://www.youtube.com/watch?v=lCETgT_Xfzg

� A type of cognitive learning � Also called modeling � Learning that occurs from watching others.

� E.C. Tolman ¡  Believed that we learn even with the absence of

rewards ¡  Cognitive Mapping

¢  Mental picture of your surroundings �  You are able to picture yourself walking to the gym

from this classroom.

� Learning that occurs, although there is an absence of rewards and punishments.

� Learning that occurs at the subconscious level.