Download Chapter 4

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project

Document related concepts

Learning theory (education) wikipedia , lookup

Behaviorism wikipedia , lookup

Psychological behaviorism wikipedia , lookup

Classical conditioning wikipedia , lookup

Operant conditioning wikipedia , lookup

Transcript
Learning
This multimedia product and its contents are protected under copyright law. The following are
prohibited by law:
any public performance or display, including transmission of any image over a network;
preparation of any derivative work, including the extraction, in whole or in part, of any images;
any rental, lease, or lending of the program.
Copyright © 2007 Allyn & Bacon
Learning
A relatively permanent change in behavior that
results from experience


Habituation: The learning that occurs when
repeated exposure to a stimulus decreases an
organism’s responsiveness to the stimulus
Types of learning



Classical conditioning
Operant conditioning
Cognitive and social learning
Copyright © 2007 Allyn & Bacon
Classical Conditioning: Examples




Sound of a dentist’s drill: sweaty palms
Sight of significant other: smiling
Smell of a certain beverage: nausea
Noise of a can opener: cat comes running
How does this happen?
Copyright © 2007 Allyn & Bacon
Classical Conditioning


Discovered (accidentally) by Ivan Pavlov
Components




Unconditioned Stimulus (US)
Unconditioned Response (UR)
Conditioned Stimulus (CS)
Conditioned Response (CR)
Copyright © 2007 Allyn & Bacon
Pavlov’s Observation

Studied digestion in dogs



Presented meat powder
and measured salivation
Dogs started salivating
before food was
presented
Why?
Copyright © 2007 Allyn & Bacon
Pavlov’s Experiment: Phase 1

Food (US): salivation (UR)


Reflexive response
Tone: nothing
Copyright © 2007 Allyn & Bacon
Pavlov’s Experiment: Phase 2

CS is repeatedly paired with the US


A tone is sounded before the food is
presented
Acquisition
Copyright © 2007 Allyn & Bacon
Pavlov’s Experiment: Phase 3

Eventually, the CS elicits a new CR.

Classical conditioning is complete when
hearing the tone by itself causes salivation.
Copyright © 2007 Allyn & Bacon
Classical Conditioning:
Conditioned Emotional Response



Avoidance learning
Conditioned emotional response
Phobias



Little Albert
Biological preparedness
Contrapreparedness


Easy to develop a snake phobia
Hard to develop a car door phobia
Copyright © 2007 Allyn & Bacon
Classical Conditioning


Extinction
Spontaneous recovery
Copyright © 2007 Allyn & Bacon
Classical Conditioning


Stimulus generalization
Stimulus discrimination
Copyright © 2007 Allyn & Bacon
Dissecting Conditioning

Learning to be afraid






Information registers in the brain
Amygdala reacts
Hippocampus helps store associations with
context
Central nucleus of amygdala kicks in
Other brain areas contribute
Sets of neurons become linked
Copyright © 2007 Allyn & Bacon
Classical Conditioning Applied

Drug overdoses






Conditioned compensatory response
Smoking: environmental cues
Therapy: systematic desensitization
Advertising: sex appeal
Anticipatory nausea
Conditioning and the immune system
Copyright © 2007 Allyn & Bacon
Types of Learning

Classical conditioning

Operant conditioning

Cognitive and social learning
Copyright © 2007 Allyn & Bacon
Operant Conditioning: Examples




Tantrums are punished: fewer tantrums
Tantrums bring attention: more
tantrums
Slot machine pays out: gamble more
Reward dog for sitting: dog is likely to
sit
How does this happen?
Copyright © 2007 Allyn & Bacon
Operant Conditioning
The process whereby a behavior becomes
associated with its consequences

Thorndike’s puzzle box

Law of Effect
Copyright © 2007 Allyn & Bacon
Operant Conditioning: Skinner Box
Copyright © 2007 Allyn & Bacon
Operant Conditioning: Principles


Stimulus-response
Reinforcement



Positive reinforcement
Negative reinforcement
Punishment


Positive punishment
Negative punishment
Copyright © 2007 Allyn & Bacon
Effective Punishment


Should be swift, consistent, and
appropriately aversive
Challenges



Increase in aggressive behaviors
Fear the person who punishes
Most effective when combined with
reinforcement for desired behavior
Copyright © 2007 Allyn & Bacon
Reinforcement


Primary and secondary reinforcers
Behavior modification


Are grades in school a “token” system?
Immediate vs. delayed reinforcement

Party tonight or study for exam in 2 days?
Copyright © 2007 Allyn & Bacon
Beyond Basic Reinforcement


Generalization
Discrimination




Discriminative stimulus
Extinction
Spontaneous recovery
Shaping

Successive approximations
Copyright © 2007 Allyn & Bacon
Reinforcement Schedules






Continuous
Partial
Fixed interval
Variable interval
Fixed ratio
Variable ratio
Copyright © 2007 Allyn & Bacon
Operant Conditioning and the Brain

Dopamine

Helps you adjust and organize your behavior
to achieve your goals
Copyright © 2007 Allyn & Bacon
Classical vs. Operant
Conditioning
Classical conditioning



Learned association
between US and CS
Organism is passive
Responses elicited
Operant conditioning



Associate response
and reinforcement
Organism is active
Responses emitted
Shared features
– Avoidance learning
– Extinction and spontaneous
recovery
– Generalization and discrimination
Copyright © 2007 Allyn & Bacon
Types of Learning

Classical conditioning
Operant conditioning

Cognitive and social learning

Copyright © 2007 Allyn & Bacon
Cognitive Learning

Latent learning

Tolman’s rats: cognitive maps
Copyright © 2007 Allyn & Bacon
Cognitive Learning

Insight learning


“Aha” experience
Sultan the chimpanzee
Copyright © 2007 Allyn & Bacon
Observational Learning

Bandura’s social learning theory



Bobo doll study
Modeling
Learning from models
Copyright © 2007 Allyn & Bacon