Download Lectures_Grad_2015_files/Catania ch 1-4 all

Catania Chapters 1-4
Part 1
1. What distinction is Catania suggesting
between movements and actions? Why does
he conclude that not all movement is
behavior and not all behavior is movement?
2. What is the distinction between elicited and
emitted behavior and between stimuli that
elicit versus those that occasion behavior.
Kelly G. Wilson, Ph.D.
Learning?
Within this System of Theorizing
• “a relatively permanent change in
behavior as result of experience”
• But what is behavior, experience, and
“permanent?”
• Remaining at the level of observation—is
it a change in behavior?
• But what about when it isn’t being
displayed?
• Is learning a change in the organism?
• Learning is the evolving, dynamic
interaction of environment and behavior
• Behavior is always behavior in and with
a context
• This is as close as I can currently come
to a definition that remains true to the
root metaphor and the stated purpose of
the analysis
Responses
• Responses as movements?
• Sometimes responses aren’t
movements
• We will only define responding in
terms of its relation to current and
historical context (environment)
Behavior:
Probability, Preference, & Liking
• Sometimes one behavior is more
likely than another
• Preference
– As cause?
– Need to consider context
• Appetitive, Aversive, and Neutral
– Yes, context again
Stimuli
• Stimulus as object?
• This is not physics
• Sometimes stimuli aren’t objects
– e.g., Shock goes off, schedule Sr+
richens
• What is a stimulus stimulating if there
is no response?
• We will only define stimuli in terms of
their relation to responding
5 Experimental Operations
1.
2.
3.
4.
Stimulus Presentation
Consequential Operations
Establishing Operations
Stimulus Control Superimposed on
stimulus presentations
5. Stimulus Control Superimposed on
consequential operations
Stimulus Presentations
• Operation
–Presentation of a stimulus
• Outcome
–Alters the probability of response
class that follows the operation
• Often species specific, highly specific
patterns of behavior (not perfectly fixed)
• Raises the probability to near 1.0
• Process
–Elicitation
Establishing Operations
• Operation
– Any operation that alters the
effectiveness of some consequence
• Outcome
– Alters the (1) probability of a response
class that has produced that particular
reinforcer by (2) momentarily altering
the effectiveness of that reinforcer
• Process
– Deprivation, satiation
Consequential Operations
• Operation
– Presentation of a stimulus following a
response
• Outcome
– Alters the probability of a class of
response that precedes the operation
• Process
– Consequation (most general—but weird)
– Reinforcement
– Punishment
Stimulus-Control Superimposed
on Stimulus Presentation
• Operation
– Presenting a neutral stimulus prior to
presenting an eliciting stimulus
(neutral???)
• Outcome
– Conditioned elicitation: previous neutral
stimulus comes to have some of the
psychological functions of the elicitor
• Process
– Classical/respondent conditioning
Stimulus-Control Superimposed
on Consequential Operations
• Operation
– Presenting some stimulus only when a
consequence is available
• Outcome
– Discriminated Operant: presentation of previous
neutral stimulus now alters the probability of
response class that has produced that
consequence
– stimulus comes to have discriminative functions
• Process
– Discrimination learning
Antecedents and Consequences
• Antecedents precede behavior
– Antecedent stimulation is the way we will
talk about the context that immediately
precedes a response
• Consequences follow behavior
– Consequential stimulation is the way we will
talk about the context that immediately
follows a response
• History might include a more distal
description of both antecedents and
consequences (even though hx itself is
antecedent)
Catania Chapters 1-4
Part 2
Antecedents and Consequences,
Unlearned and Learned
Kelly G. Wilson, Ph.D.
Behavior Occurs in Context
• With respect to antecedents, we will
need to understand
– immediate antecedents and
– the history of those antecedents
• With respect to consequences, we will
need to understand
– immediate consequences, and
– the history of those consequences
Elicited Responses
• When a response is primarily sensitive to
antecedent stimulation (but not to
consequences) it is elicited or
respondent behavior. Antecedent
raises probability to near 1.0
Emitted Responses
• When a response is sensitive to both
antecedent and consequential
stimulation it is emitted or operant
behavior
Consider it this way
• Respondent and operant behavior is never
strictly separable
• Both learning processes are ongoing at all
times
• Op/resp are ways of speaking and there are
limiting conditions where this distinction does
not operate usefully
• Think about a behavioral stream and it’s
sensitivity to antecedents and consequences
• Think about the purpose of the particular
analysis
Typical Operant Example
Behavioral Contrast
•
•
•
•
• When one component of a multiple
schedule is placed on extinction,
behavior increases in the other
component, even though the level of
reinforcement remains the same.
• We cannot explain these changes based
solely on the operant contingencies
Green light comes on
Pigeon pecks the key
Food access is granted
If we want to predict and influence the
rate of keypecks we can do so without
thinking much about respondent
conditioning
• But…
Behavioral Contrast
More on Elicited Responses
• Some elicited behavior requires no
learning
• Some elicited behavior requires learning
• This behavior is called elicited or
respondent behavior
• When it requires learning it is called
conditioned elicitation, still
respondent behavior
2-term Contingency (no learning)
Elicited\Respondent Behavior
• Stimulus presentation (operation)
• Stimulus --> Response
• These were the “reflexes” or
elicitation that were examined
early on by physiologists
• This behavior is not wholly fixed
• Response strength
– (S) Puff of air --> (R) eye blink
– (S) Dog food --> (R) salivation
– (S) Loud noise --> (R) cringe
• This is the earliest relation we
understood well
– Latency
– Magnitude
– Duration
• Weak response= long latency, small magnitude,
short duration
• Strong response= short latency, large magnitude,
long duration
Elicited\Respondent Behavior
• Response strength varies with stimulus
magnitude
• In response to inhibiting stimulus
– e.g., inhibition of contentment calls in birds
– Even here we are seeing antecedent control
• Strength varies with successive elicitations
Effects of Successive Elicitations
• Summation
– Sub-threshold stimulus has eliciting effects given
repeated presentations
• Habituation
– Successive presentations produce weaker and weaker
responses (not to be confused with extinction!!! And
I mean it!)
• Potentiation
– Successive presentations produce stronger and
stronger responses
• Effects diminish with passage of time
Other Patterns of Elicitation
2-term Contingency (learned)
• Sensitization
• Stimulus -->Response
– One stimulus amplifies the eliciting
effects of another stimulus
• Shock, noise for startle response
• Strange sound, touch for startle response
– Not to be confused with potentiation
– Bell -->Salivation
– Tone -->eye blink
– Ready -->cringe
• Stimulus control superimposed on
stimulus presentation (operation)
• For this, we need a history of
presentations (learning)
• Conditioned elicitation
2-term contingency (learned)
but, how does this happen?
mmmmm…
dog food.
This is elicitation.
mmmmm…
dog food.
Hx of pairing
Then: nothing.
whatever….
mmmmm…
bell/dog food.
This is conditioned elicitation.
mmmmm…
dog food.
Conditioned Elicitation
• Successive presentations of the CS will
result in decrements in elicitation
• This is extinction
• In the realm of respondents, extinction
always refers to conditioned elicitors
Effects of Time Since Last Elicitation
From Elicited to Emitted Behavior
• Time since last elicitation will produce
decrements in the following processes
• Reflex is one example of an S-R relation
• But there are other relations between
stimuli and responses
– Summation—stimulus returns to its subthreshold capacity to elicit a response
– Habituation—stimulus returns to its original
capacity to elicit a stronger response
– Potentiation—stimulus returns to its original
capacity to elicit a weaker response
Schedule Induced Polydipsia
Adjunctive behavior
An Example
3 grams of food
• One kind of responding reliably follows
another kind of responding
• Schedule induced polydipsia
Feed Pinky 1 gram at a time then
pause with available water
– Drinking follows eating in rats, independent
of the quantity of food
• Other examples might include running
after eating, grooming, etc.
Pinky drinks 3 milliliters of water
3x for a total of 9 milliliters of water
But if we divide it into .2 gram each
time….well pinky will drink until he
is sick—15 times 3 milliliters
Superstitious Pigeons
Elicited to Emitted
• Food is introduced into an experimental
chamber at regular intervals—say once very
two minutes on a fixed schedule
• Over time behavior takes on a pattern
• The pattern varies from pigeon to pigeon
• Accidental strengthening effects of
consequences
• Think about human examples???
• Some behaviors begin as reflexes or
respondent behaviors, but become
operant
• Suckling—begins with rooting reflex
• Rooting reflex disappears
• Suckling becomes both more refined
and becomes independent of eliciting
stimuli
Some working examples
• 1) A sound (e.g., the word "Catania") is
produced every time pepper spray is
administered to you. Soon you cry every time
the word is muttered. What is producing the
sound “Catania?”
• 2) If I shock a dog with a cattle prod, the dog
always yelps. What is applying the shock?
• 3) When the underside of an infant’s foot is
tickled, the toes will splay outward (the
Babinski reflex). What is the tickling?
• 6) When Bart gives Lisa a hug (i.e. is being nice)
only when Aunt Patty is around because she
always gives him $10.00 for good behavior.
• 7) Kicking someone in the knee makes aspirin
more reinforcing. What is the kick?
• 8) A child playing in the driveway forgets to pick
up her toys. Her mother arrives home from
work later that day and, not seeing the toys,
runs over them with the car. The next day, the
child remembers to pick up her toys from the
• 4) When a dog comes into contact with an
electric fence that I installed, the dog is shocked.
The dog subsequently is less likely to approach the
fence. What is the application of the shock?
• 5) When my sister’s dog first became a member
of the family in our home, he was not allowed to
enter the living room. Every time he stepped on
the living room carpet, someone in the house would
shake a soda can full of pennies, causing our dog to
get scared and run off of the carpeting. Shaking
• 9) Water is consequence of rat pressing
lever. The temperature of the rat's
environment is increased. The water becomes
more valuable.
• 10) In order to get the rats in her lab to
work for water, Kolleen allowed the rats to
have water only once a day for 20 minutes.
Subsequent to this deprivation, the rats were
more likely to pull a chain for water. What is
the water deprivation?
• 11) When Neville Longbottom, one of Harry
Potter’s friends, melts a classmate’s cauldron
and has to serve detention with Professor
Snape in the dungeon, he must perform nasty
deeds such as taking the guts out of a bunch
of horned toads. His willingness to study for
his Potions class increases exponentially when
he is in that dungeon room. So when he goes
there on an adventure with Harry Potter, even
though he’s not serving detention, his
• 14) Giving a child unlimited access to their
Halloween candy may alter the effectiveness
of Halloween candy as a reinforcer for good
behavior.
• 15) If an owner calls the dog’s name and
the dog comes to the owner, the owner gives
the dog a food. If doing this several times, the
dog will come easily after the owner calls the
dog’s name.
• 12) A subject is placed in a chair with a red
button on a panel in front of the chair. If the red
button is pressed then the chair will begin to vibrate
providing a therapeutic massage for the lower back
area.
• 13) A dog may avoid an electric wire only when it
hears a hum. Touching the wire resulted in an
electric shock only when the electric box that
generates the electricity produced a humming
sound.