Download Chapter 4 notes rev

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project

Document related concepts

Attribution (psychology) wikipedia , lookup

Applied behavior analysis wikipedia , lookup

Neuroeconomics wikipedia , lookup

Psychophysics wikipedia , lookup

Verbal Behavior wikipedia , lookup

Adherence management coaching wikipedia , lookup

Behavior analysis of child development wikipedia , lookup

Psychological behaviorism wikipedia , lookup

Behaviorism wikipedia , lookup

Classical conditioning wikipedia , lookup

Insufficient justification wikipedia , lookup

Operant conditioning wikipedia , lookup

Transcript
10/12/10
Learning
Chapter 4
Homework for next -me: •  Journal Task #37 •  Experimental Deadline 2: October 13th! –  Alterna-ves must be submiFed by 5pm •  Traphagen 330 Pavlovian Drooling Pups! - Russian physiologist, studied digestion, Implant devices,
collect saliva
- Noticed dogs salivated when they heard shoes squeaking
in the hall
- Realized this was because they heard it before being fed
- Thought what else can we pair this with  bell
1
10/12/10
Classical Condi-oning: Terms •  Uncondi-oned S-mulus (UCS): naturally occuring s-mulus that leads to a reflexive response. FOOD •  Uncondi-oned Response (UCR): the reflexive response to the uncondi-oned s-mulus. SALIVATING •  Neutral S-mulus (NS): s-mulus that previously has no effect on the desired response. BELL Classical Condi-oning: Terms •  Condi-oned S-mulus (CS): previously neutral s-mulus that elicits a reflexive response aVer repeatedly being paired with UCS. BELL •  Condi-oned Response (CR): learned reflexive response to a CS. SALIVATING •  On test: paragraph with examples, pick out the different components (UCS, CS, CR, etc.) The setup….. Before conditioning:
•  Food (UCS) causes Drooling (UCR) During conditioning:
+
After conditioning:
•  Food (UCS) is paired with the Bell (NS) –ring bell before feeding – and causes Drooling (UCR) •  Bell (CS) causes Drooling (CR) 2
10/12/10
Stimulus generalization – similar
stimuli will also evoke the response
(after conditioning occurs).
Example: A bell rings at a certain tone and a dog
salivates, if the bell rang at a higher or lower tone the
dog may still salivate. SO therefore have a
generalized stimulus.
Stimulus discrimination – stimuli are
different and response will stop
occurring.
Example: A dog is given increasingly different
sounding bells from the original meaning the stimulus
will have a decreased effect and eventually will not
respond at all.
The Pavlovs get new neighbors….. Terminology •  AcquisiLon: the formula-on of the s-mulus-­‐response associa-on •  ExLncLon: A decrease of a learned response due to repeatedly presen-ng the CS without the UCS •  Spontaneous Recovery: The reappearance of an ex-nguished response (CS presented alone) •  Example: “apple juice” and Pita Pit 3
10/12/10
Operant Condi-oning: What’s in it for me? •  Defini-on: the learning of voluntary behavior through rewards and punishments •  Watson, Skinner •  Rats in boxes, scaring babies with rats 4 Very Important Terms •  Reinforcement: any event or s-mulus, that when following a response, increases the probability that the response will occur again. •  Punishment: any event or object that, when following a response, makes that response less likely to happen again. •  PosiLve: Adding anything to the environment. •  NegaLve: Taking away anything from the environment. –  Posi-ve does not mean good; nega-ve does not mean bad! Reinforcement •  PosiLve Reinforcement: reinforcement of a response by the addi-on of something that increases the likelihood that the response will be repeated –  Example: give dog a treat when it sits •  NegaLve Reinforcement: the reinforcement of a response by the removal or avoidance of something that increases the likelihood that the response will be repeated –  Example: Parents stop nagging if you take out the garbage 4
10/12/10
Reinforcement (cont) •  Primary reinforcer: sa-sfies a basic need –  Example: food, water, shelter •  Secondary reinforcer: has no intrinsic value but becomes reinforcing when paired with a primary reinforcer –  Example: money Punishment •  PosiLve Punishment: the punishment of a response by the addi-on of something that will decrease the likelihood that the response will be repeated –  Example: Spank a child when they misbehave •  NegaLve Punishment: the punishment of a response by the removal of something that will decrease the likelihood that the response will be repeated –  Example: Grounded (removing privileges) if break curfew A helpful tool Effect on Behavior
Added to
environment
Removed
from the
environment
Increases
Decreases
Positive
Reinforcement
Positive Punishment
Negative
Reinforcement
Negative Punishment
5
10/12/10
Shaping •  DefiniLon: the reinforcement of simple steps in behavior that lead to a desired, more complex behavior •  Used a lot in a clinical seing: ie: help with phobia Schedules of Reinforcement: •  ConLnuous Reinforcement: the reinforcement of every response –  Example: give dog a treat every -me •  ParLal Reinforcement: reinforcing some, but not all, responses –  Example: buy a certain amount of coffee drinks, get a free coffee Schedule of Reinforcements •  Fixed Interval: the interval of 3me that must pass before reinforcement becomes possible is always the same –  Example: Hourly wage •  Variable Interval: the interval of 3me that must pass before reinforcement becomes possible is different for every trial or event –  Example: Pop quiz •  Fixed RaLo: the number of responses required for reinforcement is always the same –  Example: Taco Del Mar punch card •  Variable RaLo: the number of responses required for reinforcement is different for each trial or event –  Example: Slot machines (Vegas thrives because of variable ra-o!!) 6
10/12/10
LiFle Experiment, Big Consequences: Bobo!! •  Observa-onal Learning: Learning of new behavior through observa-on of a model 7