* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download Operant Conditioning
Prosocial behavior wikipedia , lookup
Psychophysics wikipedia , lookup
Abnormal psychology wikipedia , lookup
Insufficient justification wikipedia , lookup
Symbolic behavior wikipedia , lookup
Observational methods in psychology wikipedia , lookup
Behavioral modernity wikipedia , lookup
Organizational behavior wikipedia , lookup
Thin-slicing wikipedia , lookup
Neuroeconomics wikipedia , lookup
Attribution (psychology) wikipedia , lookup
Transtheoretical model wikipedia , lookup
Theory of planned behavior wikipedia , lookup
Adherence management coaching wikipedia , lookup
Classical conditioning wikipedia , lookup
Sociobiology wikipedia , lookup
Applied behavior analysis wikipedia , lookup
Descriptive psychology wikipedia , lookup
Theory of reasoned action wikipedia , lookup
Behavioral economics wikipedia , lookup
Verbal Behavior wikipedia , lookup
Psychological behaviorism wikipedia , lookup
Behavior analysis of child development wikipedia , lookup
Instrumental Conditioning Basic Procedures and Processes Instrumental or Operant Conditioning? l l l l These terms both refer to learned changes in behavior that occur as a result of the consequences of the behavior. “Instrumental ” refers to the fact that the behavior is instrumental in bringing about a given consequence. “Operant” refers to the fact that the behavior operates on the environment, that is, has an effect there. Which term you prefer to use will probably depend on whether you use a discrete-trials or free-operant methodology. Discrete-Trials Procedures l l l l l Organized as a series of learning trials Start of each trial is under control of the experimenter, not the animal. Usually focus on group averages and statistical analysis. Dependent variables: latency, speed, number of errors, etc. as functions of trials and conditions. Examples l l l Thorndike’s puzzle-box experiments Maze learning Researchers using these procedures prefer the term “instrumental conditioning.” Straight Alley Start Box Goal Box 1 Free-Operant Procedures l l l l l Monitored behavior is free to occur at any time; under the control of the animal Dependent variable usually the frequency or probability of response as functions of time and conditions Focus is on the individual subject – averaging over subjects and inferential statistics discouraged. Technology pioneered by B. F. Skinner Researchers using these procedures prefer the term “operant conditioning.” Rat in the operant chamber above is free to press the lever at any time. Operant Chamber (Rat Version) Pigeon Chamber in SoundIsolation Box Computer used to arrange contingencies and collect data 2 Cumulative Recorder Clock drive moves paper under pen at constant rate. Pen moves across by a small amount with each response. Slope of line indicates rate of responding. Reading the Cumulative Record The pen moves up a notch with each response. Consequently, the position of the pen at any moment indicates the total or cumulative number of responses produced up to that moment. The pen resets to bottom when it reaches the top of the graph, so that it stays on the paper. The paper moves under the pen at a constant rate. Tick-marks indicate reinforcer deliveries. The slope of the line at any point indicates the rate of responding. Zero rate generates a horizontal line. l l l l l l Some Definitions l Operant l l Reinforcer l l l Some well-specified behavioral act, such as pressing a lever. A consequence of a behavior that serves to “strengthen” the behavior. “Stronger” behavior is behavior that occurs more frequently, with higher probability, with shorter latency. Reinforcement l The procedure of making a reinforcer consequent on the occurrence of an operant. 3 Basic Processes l l l l Acquisition Extinction Spontaneous recovery from extinction Generalization and Discrimination Acquisition Each leverpress delivers a pellet of food to the hungry rat. From Skinner (1938) After a few presses and pellet-deliveries, responding accelerates to a high rate. Extinction Pellets were no longer delivered following lever presses. The rate of responding declined toward zero. 4 Spontaneous Recovery Note jump in rate at start of session Spontaneous recovery is observed at the start of each new extinction session after a period of rest. Generalization/Discrimination Generalization Gradient S+ A pigeon received grain for pecking a key while a vertical line (S+) was projected on the key. Extinction was in effect when S+ was absent. Tests were conducted in extinction while lines of various angle were projected on the key. The Discriminative Stimulus l l l l l l A stimulus in the presence of which a response is reinforced. A stimulus that sets the occasion for a response. Sometimes symbolized as SD or as S+ Behavior analysts refer to the “three-term contingency” in which reinforcement of a response is contingent upon the presence of S D Explains why behavior reinforced in one context does not become “stronger” in all contexts. Equivalent to Thorndike’s “situation.” 5