* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download Gluck_OutlinePPT_Ch06
Metastability in the brain wikipedia , lookup
Types of artificial neural networks wikipedia , lookup
Catastrophic interference wikipedia , lookup
Biology and consumer behaviour wikipedia , lookup
Environmental enrichment wikipedia , lookup
Synaptic gating wikipedia , lookup
Nonsynaptic plasticity wikipedia , lookup
Neural coding wikipedia , lookup
Response priming wikipedia , lookup
Neuroplasticity wikipedia , lookup
Time perception wikipedia , lookup
Donald O. Hebb wikipedia , lookup
Activity-dependent plasticity wikipedia , lookup
Psychological behaviorism wikipedia , lookup
Machine learning wikipedia , lookup
Psychophysics wikipedia , lookup
Learning theory (education) wikipedia , lookup
Eyeblink conditioning wikipedia , lookup
Stimulus (physiology) wikipedia , lookup
Chapter 6 Non-Associative Learning: Learning about Repeated Events 6.1 Behavioral Processes 6.1 Behavioral Processes • Learning about Repeated Stimuli • Learning and Memory in Everyday Life— Sex on the Beach • Perceptual Learning • Models of Non-Associative Learning 3 Behavioral Processes • Non-associative learning—learning involving only one stimulus at a time In contrast, associative learning is learning to associate one stimulus with another or to a new response. 4 Learning about Repeated Stimuli • Habituation—lack of response to originally noticeable stimuli. A widespread, basic form of learning Automatic, reflexive • Examples: Learning to ignore the hum of the air conditioner. Learning to ignore traffic sounds. Getting used to wearing glasses. Your dog getting used to your whistling. 5 The Process of Habituation • For study, researcher use the simple, controllable acoustic startle reflex. Defensive response to a loud, unexpected noise • Researchers also use orienting response. Innate response to a novel stimulus Examples: Infants turn their head and gaze at unfamiliar visual stimuli. Dogs cock their head in response to novel stimuli. 6 Habituation (a) Adapted from Davis, 1980; (b) adapted from Malcuit et al., 1996. 7 Factors Influencing Rate and Duration of Habituation • Massed exposures to stimuli facilitate habituation. After a period of no stimulus presentation, spontaneous recovery (response reappearance) can occur. • Dishabituation—novel stimulus can renew reflexive response. e.g., you make a new sound and your dog cocks his head again. 8 Learning and Memory in Everyday Life—Sex on the Beach • Sexually explicit photos and recordings elicit sexual arousal in male undergraduates. • If the stimuli are repeated, sexual habituation occurs, even without conscious awareness. • Dishabituation may be facilitated with novel stimuli, locations or lovemaking techniques. 9 Sexual Habituation and Dishabituation Adapted from Koukounas and Over, 2001. 10 The Process of Sensitization • Sensitization—a startling stimulus leads to a strong response to a later stimulus. New stimulus might otherwise evoke a weaker response. e.g., strong electric shock increases rats’ startle response to future loud noise for 10–15 minutes. • Humans can show sensitization of their startle reflexes. Skin conductance response (SCR)—change in skin’s electrical conductivity; response to emotion. 11 Sensitization of the Rat Acoustic Startle Reflex Adapted from Davis, 1989. 12 Priming • Priming—prior exposure to a stimulus can improve an organism’s recognition later. • In humans, priming often studied with wordstem completion task. Fill in the blank: MOT_____ / SUP_____ Examples: motel, motor, moth / suppose, supper, supreme 13 Priming in Blue Jays • In blue jays, recent observations of one kind of moth “primed” them for later recognition. Adapted from Bond and Kamil, 1999. 14 Perceptual Learning • Perceptual learning—prior experience with a set of stimuli make those stimuli easier to distinguish from each other. Increased ability to make fine distinctions among highly similar stimuli. • Examples: Chicken-sexers Medical diagnosticians Dog show judges 15 Mere Exposure Learning • Mere exposure learning—occurs with only exposure to stimuli, no explicit prompting. • In studies: Rats pre-exposed to shapes learned to differentiate shapes more quickly than rats with no pre-exposure. Over time, humans learned to distinguish a target scribble without feedback on accuracy. • Related to latent learning—original learning is not observed until a later time. 16 Mere Exposure Learning in Humans Adapted from J. J. Gibson and Gibson, 1955. 17 Discrimination Training • Expert perceptual training includes: Distinguishing among examples. Receiving feedback on accuracy. Mere exposure is part of this process. • In studies: Participants improved perception and discrimination of tactile stimuli with training. Perceptual learning has learning specificity (does not transfer automatically to discrimination of other stimuli). 18 Learning Specificity in Humans Adapted from Fiorentini and Berardi, 1981. 19 Spatial Learning • Learning one’s environment or surroundings (much is latent learning). • Tolman studies: rats ran maze over 22 days. Group 1 received food for reaching food box on every trial. Over time, learned maze with few errors. Group 2 received no food for ten days; on 11th day, began to receive food. Exposure-first rats showed rapid learning; ultimately showed fewer maze errors than group 1. 20 Rat Learning by Exploration Adapted from Tolman and Honzik, 1930. 21 Spatial Learning in Wasps • Tinbergen studies: Encircle wasp burrows with pinecones. After orientation flights, wasps leave to find food. Next, researchers move pinecone circles. Returning wasps search moved pinecone circles for burrows. Adapted from Tinbergen and Kruyt, 1972 (1938). 22 Models of Non-Associative Learning • What processes might be involved? Dual Process Theory Comparator Models Differentiation Theory • Each theory may explain certain features of non-associative learning. 23 Dual Process Theory • Dual process theory—habituation and sensitization are separate but parallel processes. Operate in the same manner; do so independently. Similar to neural circuits in cat spinal cords. 24 Dual Process Theory (a) Adapted from Groves and Thompson, 1970. 25 Comparator Models • Comparator models—habituation is a special form of perceptual learning. Brain experiences a stimulus and develops neural representation. Compares to existing representations of previously experienced stimuli. If no match, respond is triggered (e.g., an orienting response). If match, behavioral response is suppressed (i.e., habituated). 26 Differentiation Theory • Differentiation theory—brain develops representations over time; incorporates new details each time stimulus is presented. Brain has limited processing capabilities. Develops a vague mental representation from first stimulus exposure. Mental representations become more detailed with each subsequent exposure. 27 6.1 Interim Summary • Habituation = decreased strength or frequency of behavior after repeated exposure to the behavior-producing stimulus. In spontaneous recovery, a behavior may reappear at original level if stimulus is presented again after a delay. Behavior decreased through habituation can also be renewed (dishabituated) by a novel stimulus. Habituation is stimulus-specific. 28 6.1 Interim Summary • Sensitization = increased response to a stimulus. Exposure to a threatening or highly attractive stimulus causes a heightened response to any stimuli that follow. Sensitization is not stimulus-specific. • In priming, prior exposure to a stimulus improves the organism’s ability to recognize that stimulus later. 29 6.1 Interim Summary • In perceptual learning, experience with a set of stimuli improves the organism’s ability to distinguish those stimuli. In mere exposure learning, simply being exposed to the stimuli results in perceptual learning. Related term = latent learning (learning without corresponding changes in performance). Perceptual learning can also occur through discrimination training. Organism learns to distinguish stimuli via feedback about stimulus class. 30 6.1 Interim Summary • Many kinds of spatial learning take the form of perceptual learning. Is often latent learning that results from mere exposure as the organism explores its world. • Comparator models suggest that habituation is a special case of perceptual learning. 31 6.1 Interim Summary • In dual process theory, changes in behavioral response after repeated stimulus exposure reflect combined effects of habituation and sensitization. Habituation decreasing responses; sensitization increasing responses. • In differentiation theory, perceptual learning results from new details being added to existing stimulus representations. 32 6.2 Brain Substrates 6.2 Brain Substrates • Invertebrate Model Systems • Perceptual Learning and Cortical Plasticity • Unsolved Mysteries—Why Did Cerebral Cortex Evolve? • The Hippocampus and Spatial Learning 34 Invertebrate Model Systems • Aplysia—sea slugs with simple nervous systems, large neurons Gill-withdrawal reflex Simple sensory-glutamate-motor reflex closes gill when siphon is touched. • Aplysia serve as a simple model for nonassociative learning. • Dual process theory provides best explanation for this example. 35 David Wrobel/Visuals Unlimited Aplysia Californica 36 Neural Circuits in Gill-Withdrawl Reflex 37 Habituation in Sea Slugs • Occurs rapidly, can endure for 10–15 minutes. • Associated with decreased glutamate release. Synaptic depression—less presynaptic terminals on sensory neurons and eliminated synapses • Homosynaptic—involves only synapses activated during the habituating event. Changes in a siphon sensory neuron will not affect sensory neurons in the tail or mantle. 38 Sensitization in Sea Slugs • Mild tail shock (T) sensitizes response to stimulation of siphon and upper mantle. • Heterosynaptic—involves changes across several synapses (including those not activated by the sensitizing event). T’s interneuron releases a neuromodulator, (e.g. serotonin); arouses other sensory neurons (siphon and upper mantle). • Repeated touch to the siphon will elicit a stronger gill closure. 39 Sensitization in Aplysia 40 Perceptual Learning and Cortical Plasticity • Within sensory cortices, different neurons respond to different properties of stimulus. • Receptive field—the range of physical properties to which a neuron responds. e.g., an auditory neuron might have a range of 800–900 Hz. Field can change with experience, contributing to cortical plasticity—change in cortical organization. 41 Receptive Field in Guinea Pig Auditory Cortex Adapted from Weinberger, 2004. 42 Cortical Changes after Mere Exposure • In one study: After 3 hours finger tip stimulation, participants showed temporary discrimination learning. fMRI shows greater activation in the left somatosensory cortex. • In a similar study: Magnetoencephalographic (MEG) recording showed positive association between changes in cortical activity and quality of tactile discrimination. 43 Figures courtesy of Ben Godde, Jacobs Center for Lifelong Learning, Jacobs University Bremen, Germany Cortical Reorganization after Finger-Tip Stimulation 44 Cortical Changes after Training • Cortical areas may increase or decrease after discrimination training. • Decreases may reflect fine tuning within the cortex. Quality over quantity of neural firing • Changes correspond to the comparator models of non-associative learning. 45 Plasticity during Development • Neuroimaging studies found visual association cortical areas more activated in blind people when engaged in Braille reading and other tactile tasks. Compared to sighted people. 46 Cortical Reorganization of Opossums • Different cortical mapping was observed in opossums blinded at birth. Blinded opossums showed unique multimodal areas, responding to combination of auditory and tactile stimuli. Adapted from Kahn and Krubitzer, 2002. 47 Hebbian Learning • What is the neurological mechanism underlying cortical plasticity? 48 Hebbian Learning • Donald Hebb (1949) proposed that neurons that fire continuously strengthen their connections to each other. • Hebbian learning—forming firing patterns among contiguous neurons, speeds and strengthens behavioral responses. Neurons that fire together, wire together. Corresponds to long-term potentiation (LTP). 49 Unsolved Mysteries—Why Did the Cerebral Cortex Evolve? • The simplest multicellular organisms with a nervous system have sensory and motor neurons. • A cortex is not necessary for complex learning and memory. As seen in the octopus • Cortex may have evolved to give the brain its ability to reorganize neural connects. A mechanism for learning 50 The Hippocampus and Spatial Learning • Rats with hippocampal lesions have difficulty learning spatial tasks. e.g., radial maze • Humans with medial temporal amnesia also may have problems with spatial tasks. 51 The Hippocampus and Spatial Learning • Some neurons in rats’ hippocampal region fire only when rats move into specific external locations. O’Keefe calls neurons place cells. • Place fields—external locations associated with place cells’ maximum response. 52 • Place cell firing may be mediated by visual input (Cues or landmarks). • Visual stimuli change and place cell location may also change. Adapted from Lenck-Santini et al., 2001. Identifying Places in Rats Place cell location may rotate accordingly. 53 Place Fields Are Not Maps • Place cell-to-place field associations may develop during learning, but cells may be recycled to learn new spatial locations. • Rats’ place cells describe specific locations; do not form two-dimensional map. Beyond place cells, information is needed to form a cognitive map. Researchers still looking Possibly from cortical areas 54 6.2 Interim Summary • In marine invertebrates (e.g., Aplysia), habituation = a form of synaptic depression in circuits that link a stimulus (sensory neuron) to a reflexive response (motor neuron), as proposed by dual process theory. Habituation in Aplysia is homosynaptic; changes in one sensory neuron do not affect other sensory neurons. Sensitization in Aplysia is heterosynaptic and reflects increases in synaptic transmission. 55 6.2 Interim Summary • Cortical plasticity = cortical networks ability to adapt to internal or environmental changes. During perceptual learning, cortical changes parallel improvements in discrimination abilities. Includes refinement of neurons’ receptive fields in response to sensory inputs. Can lead to widespread changes in cortical map. In extreme cases (e.g., a form of sensory input is absent from birth), cortical map may reorganize so that active inputs take over the areas normally devoted to processing the missing inputs. 56 6.2 Interim Summary • Hebbian learning, based on the principle that neurons that fire together, wire together. Repeated exposure can strengthen associations within particular subsets of cortical neurons. Subsets then provide an increasingly reliable basis for discriminating the stimuli that activate them. A mechanism for cortical plasticity. 57 6.2 Interim Summary • Place cells = hippocampal neurons; become most active when animal is at a particular location (the place field for that neuron). Unclear how information from different place cells is linked together to form a useful spatial map for environmental navigation. • Place fields change with learning; if place cells are disrupted, so is spatial navigation. With environmental familiarity, corresponding place cells become more selective, responding to increasingly precise locations in environment. 58 6.3 Clinical Perspectives 6.3 Clinical Perspectives • Landmark Agnosia • Rehabilitation after Stroke • Man–Machine Interfaces 60 Landmark Agnosia • Stroke may cause lesions in parahippocampal region (cortex near hippocampus). Extend into the visual cortex. Adapted from Takahashi and Kawamura, 2002. 61 Landmark Agnosia • Patients may: Become disoriented in known or new locations. Have problems recognizing familiar locations in photos. Have problems recognizing faces (prosopagnosia). 62 Rehabilitation after Stroke • Stroke may cause significant loss in perceptual function (e.g., desensitized arm). Leads to the patient favoring the unimpaired arm. • To counter learned non-use: Place mitt (constraint) on unimpaired arm for most of the day; forces patient to use desensitized arm. May increase desensitized arm use in some patients. 63 Overcoming Learned Non-Use Adapted from Taub, Uswatte, and Elbert, 2002. 64 Man–Machine Interfaces • Sensory prostheses—mechanical devices; interface with neurons to produce sensation. • Example: cochlear implant Electrically stimulates the auditory nerve. Need training to interpret these “virtual sounds” (perceptual learning). Training yields initial rapid improvement with slower gains in discrimination learning over time. Recency of hearing loss is a factor in implant success. 65 Cochlear Implant Adapted from Clarke, 2002. 66 6.3 Interim Summary • Landmark agnosia = inability to identify familiar buildings and landscapes. Condition often results from damage to the parahippocampal region of the cortex. 67 6.3 Interim Summary • After stroke, many patients experience large losses in perceptual and motor function. May suffer from learned non-use. A functional limb takes over the role of a limb that still has motor function but has lost sensation. Learned non-use can be overcome by restraint therapy Individual is forced to use desensitized limb. Recovery of function in stroke patients is thought to result from cortical plasticity. 68 6.3 Interim Summary • Sensory prostheses = electronic devices that interface directly with neurons or sensory receptors. Designed to provide sensory processing capabilities individuals would not otherwise have. • Cochlear implant: Most extensively developed sensory prosthesis; used to treat profound deafness. Training leads to perceptual learning; improves ability to discriminate simulated speech sounds. 69