Download CLASSICAL CONDITIONING

Categories Of Behavior
Unconditioned
Voluntary or Looking
Babbling
operant
Crawling
Involuntary
or
respondent
Pupillary response
to bright light
GSR response to
loud noise
Conditioned
Reading
Writing
Fence jumping
GSR when telling a
lie
Blushing
IVAN PAVLOV
CLASSICAL CONDITIONING
• Context of embarrassing situation
-> blushing
• Odor of food that once made you
sick -> nausea
• Sight of parent while raiding cookie
jar -> fear
Thorndike’s Puzzle Box
B.F. Skinner
1904-1990
Pigeon in Operant Chamber
Pigeon in Operant Chamber
“SKINNER” BOX
Animal Learning Lab-200C Schermerhorn Hall
Animal Learning Lab-200C Schermerhorn Hall
Animal Learning Lab-200C Schermerhorn Hall
Instrumental Conditioning
• Doing chores
money
->
• Doing chores
->
• Telling a lie to avoid blame
avoidance
• Putting on a coat
removal chill
->
to remove
• Getting a speeding ticket
praise
->
-> punishment
Basic Conditioning Procedures
•
Instrumental conditioning
– Type R conditioning
– Operant conditioning
– Trial and Error Learning
Pavlovian Conditioning
– Type S Conditioning
– Respondent Conditioning
Type S vs. Type R Conditioning
LAW OF EFFECT
• Thorndike: Responses that are followed
by pleasurable effect is stamped in;
responses followed by unpleasurable
(painful events) are stamped out.
• Skinner: Rate of emitting responses that
are followed by a positive reinforcer is
increased; by a negative reinforcer is
decreased.
• Thorndike: Responses trained by trial and
error.
• Skinner: Responses shaped by method of
successive approximation.
TYPES OF REINFORCERS
Positive
• primary
[S+R]
food, drink, odors
• secondary
[S+r]
approval, money
Negative
• Primary
[S-R]
loud noise,
shock, bright light
• Secondary
[S-r]
angry look, bad grade,
fine
INSTRUMENTAL
CONDITIONING (Type R)
• 2-term contingency:
• response -> reinforcement
• R -> SR
• (bar press) -> (food)
• Nature of reinforcer can vary:
• Positive - S+R, S+r
• Negative - S-R, S-r
• Primary - S+R, S-R
• Secondary - S+r, S-r
CONTINGENCIES OF REINFORCEMENT:
R-> S+R
Reward training (primary
reinforcement)
R-> S-R
Punishment (primary
reinforcement)
R-> S+r
Positive secondary
reinforcement
R-> S-r
Negative secondary
reinforcement
R removes S-R Escape training
R postpones S-R Avoidance training
R -> SR
Omission training
Is Punishment Effective?
Two-term contingency is typically
“occasioned” by a discriminative
stimulus (SD)
• SD: R -> SR
• light: bar press -> food
• no light: bar press -> no food
• Nature of discrimative stimuli can vary:
– exteroceptive
– proprioceptive
– interoceptive
FUNCTIONS OF A
STIMULUS:
Eliciting
(US->UR, C->CR)
Reinforcing (S+ R, S-R, S+r, S-r)
Discriminative
(SD: R->SR;
S :R
SR)
Discriminative Operant:
• SD: R
• S :R
SR
SR
Types Of Discriminative Stimuli
• Exteroceptive:
Stimuli generated by
sensory organs.
• Proprioceptive: Stimuli generated by
muscles and tendons, e.g., doing
something by “feel” - knowing where you
are in the dark
• Interoceptive:
Stimuli generated by
internal organs; that are innervated by the
autonomic nervous system.
Skinner’s Theory of Chaining
D
r/D
r/D
r/D
R
Sn-3:Rn-3  Sn-2:Rn-2  Sn-1:Rn-1  Sn:RnS
turn
approach
seize
press
Stimuli used in Hull’s experiment on
concept formation
Schedules Of
Reinforcement
• Number (Ratio)
• n responses  SR
• Time (Interval)
• First response after t seconds SR
Basic Schedules:
• Fixed Ratio (FR)
• Variable Ratio (VR)
• Fixed Interval (FI)
• Variable Interval (VI)
Skinner Box
Cumulative Record
no responses
constant rate
accelerating
Skinner’s “Theory” Of Instrumental Conditioning
• Two-term contingency: R  SR
• Nature of reinforcer can vary: R  S [S+R, Sr, S-R, Sr].
• 3-term contingency (Discriminative operant)
SD : R  SR (light: bar press  food)
S : R  SR (no light: bar press  food)
D
r/D
r/D operants:
r/D
R
• Chaining
of discriminative
Sn-3:Rn-3  Sn-2:Rn-2  Sn-1:Rn-1  Sn:RnS
• Nature of discriminative stimulus can vary:
exteroceptive
interoceptive
proprioceptive
Skinner’s “Theory”
(cont.)
• Contingency of reinforcement can vary: R  S±R(r)
• Schedule of reinforcement can vary: Rn/t  S±R
– subject must emit n responses within a particular
time frame t.
• Verbal Behavior. Behavior that is reinforced by a
member of one’s verbal community.
• Private events. Discriminative responding to
proprioceptive or interoceptive stimuli (stimuli under
our skin). Sd : r  Sr or Sd : r  Sr.
Descartes:
“I think, therefore I
am.”
Pascal:
“The heart has reason
that reason will
never
know.”
Skinner [& Freud (& Terrace)] On Consciousness
• Consciousness is a proper subject matter for
psychology but it is not an explanation of behavior.
It is what has to be explained (e.g., Tom hit Bill
because Tom felt angry).
– Why did Tom feel angry?
– How did Tom know he was angry?
• Consciousness vs. Awareness:
– Animals are aware of objects (but only fleetingly).
– Humans are conscious of objects (because they can
name them).
Skinner [& Freud (& Terrace)] on Consciousness (Con’t.)
• Consciousness develops because it enhances
the social fabric of the verbal community. It
provides us with a sense of “other minds”,
another person’s hunger, pain, fear, rage,
sadness, truthfulness, etc. In this sense,
consciousness is adaptive.
– Internal states are inferred by adult (“You seem
hungry.”)
• Feedback about private events is not as precise
as feedback for tacting public events.
• Discriminative control of inner states (tacting)
becomes autonomous with experience.
Verbal Behavior
• Verbal Behavior. Behavior that is reinforced by a
member of one’s verbal community.
• Mands (“demands”), a 2-term contingency:
verbal response  SR [”baba”  bottle]
• Tacts - [tactus (Latin, “to point”)], a 3-term
contingency:
-SD: verbal response  Sr
[Sight of Tom’s apple]: Mary: “May I please
have an apple?”  Tom gives Mary an
apple.]
Verbal Behavior (con’t.)
Examples of discriminative control of verbal
behavior:
– echoic behavior:
*Mother says [“dog”]: “dog”  “good”
– textual behavior:
*Printed word [dog]: “dog”  “good”
– transcription:
*Write the word [d-o-g]: d-o-g  “good”
– intraverbal responses:
*Printed word [c-h-I-e-n]: “dog”  “bien”
*“How are you?”: “Fine thanks” 
“good”
*Printed letters [Na]: “sodium”  “good”