Download Chapter Five Learning

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project

Document related concepts

Learning theory (education) wikipedia , lookup

Behaviorism wikipedia , lookup

Psychological behaviorism wikipedia , lookup

Classical conditioning wikipedia , lookup

Operant conditioning wikipedia , lookup

Transcript
Chapter Five
Learning
Did You Know That…
• Déjà-vu may be a learned response?
• In an early study, a young boy learned to
fear a white rat after experimenters
repeatedly made loud noises by banging
steel bars behind his head while the rat
was present?
Copyright © Houghton Mifflin Company. All rights reserved.
5-2
Did You Know That… (Cont’d)
• Phobias may be acquired through the
same learning principles that Pavlov
discovered, based on his studies of
digestion in dogs?
• Salivating to the sound of a tone may not
be harmful, but salivating at the sight of a
Scotch bottle may well be dangerous to
people battling alcoholism?
Copyright © Houghton Mifflin Company. All rights reserved.
5-3
Did You Know That… (Cont’d)
• Scheduling tests on specific days may
inadvertently reinforce students to cram
just before exams and to slack off
afterwards?
• Many people develop fears of various
creatures even though they have had no
direct negative experiences with them?
Copyright © Houghton Mifflin Company. All rights reserved.
5-4
What is Learning?
• A relatively permanent change in behavior
that results from experience
• Learning is adaptive
• Three major types of learning:
• Classical conditioning
• Operant conditioning
• Cognitive learning
Copyright © Houghton Mifflin Company. All rights reserved.
5-5
Module 5.1
Classical Conditioning: Learning
Through Association
Module 5.1 Preview Questions
• What is learning?
• What is classical conditioning?
• What roles do extinction, spontaneous
recovery, stimulus generalization, and
discrimination play in classical
conditioning?
• What stimulus characteristics strengthen
conditioned responses?
Copyright © Houghton Mifflin Company. All rights reserved.
5-7
Module 5.1 Preview Questions (Cont’d)
• What is the cognitive perspective on
classical conditioning?
• What are some examples of classical
conditioning in daily life?
Copyright © Houghton Mifflin Company. All rights reserved.
5-8
Classical Conditioning
• Discovered by a Russian physiologist,
Ivan Pavlov (1849-1936)
• Learning by association
Copyright © Houghton Mifflin Company. All rights reserved.
5-9
Figure 5.1: Apparatus Similar to One Used
in Pavlov’s Experiments
Copyright © Houghton Mifflin Company. All rights reserved.
5-10
Figure 5.2: Diagramming Classical
Conditioning
Copyright © Houghton Mifflin Company. All rights reserved.
5-11
Extinction and Spontaneous Recovery
• Extinction: The gradual weakening and
eventual disappearance of a CR
• Spontaneous Recovery: The spontaneous
return of a CR following extinction
• Reconditioning: The process of relearning
a CR after extinction
Copyright © Houghton Mifflin Company. All rights reserved.
5-12
Generalization and Discrimination
• Stimulus Generalization: Tendency of
stimuli similar to the CS to elicit the CR
• One explanation for feelings of déjà-vu
• Stimulus Discrimination: The ability to
differentiate among related stimuli
Copyright © Houghton Mifflin Company. All rights reserved.
5-13
Figure 5.3: Stimulus Generalization and
Discrimination
Copyright © Houghton Mifflin Company. All rights reserved.
5-14
Stimulus Characteristics that Strengthen
Conditioned Responses
• Frequency of pairings
• Timing
• Intensity of US
Copyright © Houghton Mifflin Company. All rights reserved.
5-15
Cognitive Perspective
• Robert Rescorla: Conditioning depends on
the informational value of the CS
• CS must reliably predict the occurrence of the
US.
• Cognitive perspective on classical
conditioning
• Has important survival implications
Copyright © Houghton Mifflin Company. All rights reserved.
5-16
Examples of Classical Conditioning
• Conditioned emotional reactions (CER)
• Watson and Rayner’s Little Albert experiment
•
•
•
•
•
Phobias
Positive emotions
Drug cravings
Conditioned taste aversions
Immune system changes
Continue
Copyright © Houghton Mifflin Company. All rights reserved.
5-17
Figure 5.4: The Conditioning of “Little Albert”
Return
Copyright © Houghton Mifflin Company. All rights reserved.
5-18
Module 5.2
Operant Conditioning:
Learning Through Consequences
Module 5.2 Preview Questions
• What is Thorndike’s Law of Effect?
• What is operant conditioning?
• What are the different types of reinforcers?
• What are schedules of reinforcement, and
how do they differ?
Copyright © Houghton Mifflin Company. All rights reserved.
5-20
Module 5.2 Preview Questions (Cont’d)
• How are schedules of reinforcement
related to learning?
• Why are psychologists concerned about
the use of punishment?
• What are some applications of operant
conditioning?
Copyright © Houghton Mifflin Company. All rights reserved.
5-21
Classical vs. Operant Conditioning
• Classical Conditioning: Learning results
from the association between stimuli
before a response occurs
• Operant Conditioning: Learning results
from the association of a response with its
consequences
Copyright © Houghton Mifflin Company. All rights reserved.
5-22
Figure 5.5: Thorndike’s Puzzle Box
Copyright © Houghton Mifflin Company. All rights reserved.
5-23
Thorndike’s Law of Effect
• The tendency of a response to occur depends
on the effects it has on the environment.
• Responses that have satisfying effects are
strengthened and more likely to occur again.
• Reinforcement
• Responses that lead to discomfort are
weakened and less likely to occur again.
• Punishment
Copyright © Houghton Mifflin Company. All rights reserved.
5-24
B. F. Skinner and Operant Conditioning
• Skinner believed in radical behaviorism.
• Behavior is completely determined by
environment and genetics.
• Free will is an illusion or a myth.
• Organisms learn responses that operate
on the environment to produce
consequences.
• “Operant conditioning” or “instrumental
learning”
Copyright © Houghton Mifflin Company. All rights reserved.
5-25
Operant Conditioning
• Consequences of a response determines the
likelihood that the response will occur again.
• The response is called an operant response.
• A reinforcer is the stimulus or event that
increases the likelihood that the behavior it
follows will be repeated.
• The longer the reinforcement is delayed, the weaker
its effects will be.
• Operant conditioning can be used to explain
some forms of superstitious behavior.
Copyright © Houghton Mifflin Company. All rights reserved.
5-26
Principles of Operant Conditioning
• Discriminative Stimulus: A cue that signals
reinforcement is available if a particular
response is made
• Types of Reinforcement:
• Positive: Reinforce by adding something
pleasant
• Negative: Reinforce by removing something
unpleasant
Copyright © Houghton Mifflin Company. All rights reserved.
5-27
Figure 5.6: Types of Reinforcers
Copyright © Houghton Mifflin Company. All rights reserved.
5-28
Primary vs. Secondary Reinforcers
• Primary Reinforcers: Reinforcers that are
intrinsically rewarding because they satisfy
basic biological needs or drives
• Secondary Reinforcers: Reinforcers that
develop their reinforcing properties
because of their association with primary
reinforcers
Copyright © Houghton Mifflin Company. All rights reserved.
5-29
Shaping
• Application of the method of successive
approximations
• Reinforce responses that are closer and
closer to correct response
Copyright © Houghton Mifflin Company. All rights reserved.
5-30
Extinction
• Process by which responses are
weakened and eventually eliminated
• Occurs when the response is repeatedly
performed but is no longer reinforced
Copyright © Houghton Mifflin Company. All rights reserved.
5-31
Schedules of Reinforcement
• When is reinforcement delivered?
• Continuous Reinforcement: Every
response is reinforced.
• Partial Reinforcement: Only a portion of
the responses is reinforced.
• Ratio schedules: fixed or variable
• Interval schedules: fixed or variable
Copyright © Houghton Mifflin Company. All rights reserved.
5-32
Figure 5.7: Rates of Response Under
Different Schedules of Partial Reinforcement
Source: Adapted from
Skinner, B. F. (1961).
Cumulative Record (3rd ed.)
Englewood Cliffs, NJ:
Prentice Hall.
Copyright © Houghton Mifflin Company. All rights reserved.
5-33
Escape and Avoidance Learning
• Escape Learning: Escape an aversive
stimulus by performing an operant
response
• Avoidance Learning: Avoid an aversive
stimulus by performing an operant
response
Copyright © Houghton Mifflin Company. All rights reserved.
5-34
Punishment
• Consequence that weakens or suppresses
a response
• Removal of a reinforcing stimulus
• Introduction of an aversive stimulus
Copyright © Houghton Mifflin Company. All rights reserved.
5-35
Figure 5.8: Types of Punishment
Copyright © Houghton Mifflin Company. All rights reserved.
5-36
Punishment vs. Negative Reinforcement
• Punishment
• Introduces an aversive stimulus
• Weakens a behavior
• Negative reinforcement
• Removes an aversive stimulus
• Strengthens a behavior
Copyright © Houghton Mifflin Company. All rights reserved.
5-37
Drawbacks of Punishment
• May suppress undesirable behavior, but
does not eliminate it
• Does not teach new behaviors
• Can have undesirable consequences
• May become abusive
• May represent a form of inappropriate
modeling
Copyright © Houghton Mifflin Company. All rights reserved.
5-38
Table 5.1: Comparing Reinforcement and
Punishment
Copyright © Houghton Mifflin Company. All rights reserved.
5-39
Applications of Operant Conditioning
• Biofeedback training
• Behavior modification
• Token economy program
• Programmed instruction
• Computer-assisted instruction
Copyright © Houghton Mifflin Company. All rights reserved.
5-40
Module 5.3
Cognitive Learning
Module 5.3 Preview Questions
• What is cognitive learning?
• What is insight learning?
• What is latent learning?
• What is observational learning?
Copyright © Houghton Mifflin Company. All rights reserved.
5-42
Cognitive Learning
• Involves mental processes that cannot be
directly observed
• Premise is that we are capable of new
behaviors without actually having had the
chance to perform them or being
reinforced for them
Copyright © Houghton Mifflin Company. All rights reserved.
5-43
Insight Learning
• Wolfgang Köhler’s (1927) experiment with
Sultan the chimp
• Insight Learning: Process of mentally
working through a problem until the
sudden realization of a solution occurs
• The “Aha!” phenomenon
• Requires restructuring or reorganizing the
problem on one’s mind to form a solution
Copyright © Houghton Mifflin Company. All rights reserved.
5-44
Figure 5.9: Tolman and Honzik’s Study of
Latent Learning
Copyright © Houghton Mifflin Company. All rights reserved.
5-45
Latent Learning
• “Hidden” learning occurs without
reinforcement.
• Learned behavior displayed only when
reinforced
• Tolman: The rats had developed a
cognitive map of the maze.
• Mental representation of maze
Copyright © Houghton Mifflin Company. All rights reserved.
5-46
Observational Learning
• Acquire new behaviors by imitating
behaviors observed in others
• Also called vicarious learning or modeling
• Allows us to become capable of behaviors
even before have chance to do the
behaviors ourselves
Copyright © Houghton Mifflin Company. All rights reserved.
5-47
Observational Learning (Cont’d)
• Albert Bandura: Children learn to imitate
aggressive behavior.
• “Bobo doll” studies
• Influence of modeling generally stronger
when:
• Model is similar to the learner
• Positive reinforcement for performing the
behavior is evident
Copyright © Houghton Mifflin Company. All rights reserved.
5-48
Application: Module 5.4
Putting Reinforcement into Practice
Module 5.4 Preview Question
• What steps are involved in applying
reinforcement principles?
Copyright © Houghton Mifflin Company. All rights reserved.
5-50
Modifying Behavior
• Important to establish a clear contingency
between the desired behavior and the
reinforcement
• Contingency contracting involves an
exchange of desirable reinforcers.
Copyright © Houghton Mifflin Company. All rights reserved.
5-51
Applying Reinforcement
•
•
•
•
•
•
•
Be specific.
Use specific language.
Select a reinforcer.
Explain the contingency.
Apply the reinforcer.
Track frequency of the desired behavior.
Wean the child from the reinforcer.
Copyright © Houghton Mifflin Company. All rights reserved.
5-52
Giving Praise
• Make eye contact with the child and smile
while giving praise.
• Use hugs.
• Be specific.
• Avoid empty flattery.
• Reward the effort, not the outcome.
• Avoid repeating yourself.
• Don’t end on a sour note.
Copyright © Houghton Mifflin Company. All rights reserved.
5-53