Download Mechanism for Understanding and Imitating Actions

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project

Document related concepts

Neural modeling fields wikipedia , lookup

Self-awareness wikipedia , lookup

Biological neuron model wikipedia , lookup

Cognitive neuroscience of music wikipedia , lookup

Cognitive neuroscience wikipedia , lookup

Neuroplasticity wikipedia , lookup

Evolution of human intelligence wikipedia , lookup

Artificial general intelligence wikipedia , lookup

Neuroesthetics wikipedia , lookup

Brain Rules wikipedia , lookup

Holonomic brain theory wikipedia , lookup

Animal consciousness wikipedia , lookup

Neuropsychology wikipedia , lookup

Activity-dependent plasticity wikipedia , lookup

Neural coding wikipedia , lookup

Donald O. Hebb wikipedia , lookup

Single-unit recording wikipedia , lookup

Embodied cognitive science wikipedia , lookup

Neuroanatomy wikipedia , lookup

Neural oscillation wikipedia , lookup

Enactivism wikipedia , lookup

Biological motion perception wikipedia , lookup

Pre-Bötzinger complex wikipedia , lookup

Brain–computer interface wikipedia , lookup

Optogenetics wikipedia , lookup

Premovement neuronal activity wikipedia , lookup

Channelrhodopsin wikipedia , lookup

Neural correlates of consciousness wikipedia , lookup

Feature detection (nervous system) wikipedia , lookup

Synaptic gating wikipedia , lookup

Neuroeconomics wikipedia , lookup

Nervous system network models wikipedia , lookup

Time perception wikipedia , lookup

Imitation wikipedia , lookup

Metastability in the brain wikipedia , lookup

Embodied language processing wikipedia , lookup

Neuropsychopharmacology wikipedia , lookup

Mirror neuron wikipedia , lookup

Transcript
Understanding Actions:
Mu Rhythms and Mirror Neurons
Jaime A. Pineda, Ph.D.
Cognitive Neuroscience Laboratory
November 23, 2004
Reading Minds

Understanding the behavior of others
The capacity to achieve internal
descriptions of actions and use them to
organize one’s own future behaviors

Neural mechanisms for understanding
actions and their intentions



Mirror neurons
Mu rhythms
The effects on learning and social
interactions
What Is It Like To Be a Bat?
“Consciousness and subjective
experience cannot be reduce to
brain activity.”
Thomas Nagel, The Philosophical Review 83 (1974).
Questions


What are mirror neurons?
How might these neurons help us understand actions
and their intentions?





Can they help us understand “what it is like to be …?”
How is mirror neuron activity related to imitation
learning?
Is imitation learning important for social interactions?
What’s the relationship between mirror neurons and EEG
mu rhythms?
Why would a dysfunctional mirror system produce
autistic-like behaviors?
What Is an Action?


Intentional motor behavior
Goal-directed behavior that produces a reward


Attainment of the goal
Increased dopamine release
Rizzolatti et al., Nature Reviews, 2001, 2, 661-670
How Do We Understand Actions?

Visual hypothesis

Involves striate, extrastriate,
inferotemporal lobe and superior
temporal sulcus, among others
An Observation/Execution Matching System?

Direct-matching hypothesis


Map visual information onto
motor representations of
the same action
Mirror system: direct bridge
between perception and action


Mirror neurons
Mu rhythms
An Observation/Execution Matching System?

A dysfunctional “mirror
system” produces problems
in understanding actions
Biological Motion

Visual system's ability to
recover object information
from sparse input



Gender
Activity engaged in
Emotional state
Biological Motion Perception: Monkeys

Perret and colleagues
(1989; 1990; 1994)
Cells in superior
temporal polysensory
area (STPa) of the
macaque temporal
cortex appear sensitive
to biological motion
Oram & Perrett, J. Cog. Neurosci., 1994, 6(2), 99-116
Biological Motion Perception: Humans


An area in the superior
temporal sulcus (STS) in
humans responds to
biological motion
Other areas, including the
amygdala, do as well
Grossman et al. J. Cog. Neurosci., 2000, 12(5), 711-720
Brain Circuit for Social Perception (SP)
• SP is processing of
information that results
in the accurate analysis
of the intentions of
others
• STS involved in the
processing of a variety of
social signals
Allison et al., Trends in Cog. Sci., 2000, 4, 267-272
Reading Other Minds

We understand actions (and intentions) when we
map the visual representation of the observed
action onto our motor representation of the same
action
Rizzolatti et al., Nature Reviews, 2001, 2, 661-670
Mirror Neurons

Found in:




area F5 of monkey (homolog of Broca’s area?)
STSa (homolog of Wernicke’s area?), and
inferior parietal cortex (7b)
Activated by:


Goal directed actions (reaching, grasping, holding)
performed by “biological” agents
Observation of similar actions


Strictly versus broadly congruent
Do not respond to target alone or intransitive
gestures (i.e., nonobject directed)
Di Pellegrino et al., Exp. Brain Res., 1992, 91, 176-80
Mirror Neuron Activity
Rizzolatti et al., Cogn. Brain Res., 1996, 3:131-141
Understanding Actions?
Grasping
Mimicking
Umilta et al. Neuron, 2001, 32: 91-101
Functional Significance

Understanding action (Rizzolatti et al., 2001)

Imitation learning (Jeannerod, 1994)

Only in humans and apes?
Mirror System in Humans: Neuroimaging
Buccino et al. J. Cogn. Neurosci., 2004, 16: 1-14
Mirror System in Humans
Buccino et al. Eur. J. Neurosci., 2001, 13: 400-404
Neurophysiological Evidence

Gaustaut and Bert, 1954 and Cohen-Seat et al., 1954


Observing actions of another person blocks mu rhythm
(8-13 Hz over sensorimotor areas) of the observer
Recently confirmed



Pineda et al., 1997, 2000
Cochin et al., 1998, 1999
Hari et al. 1998
Frequency Analysis of Mu Rhythm
P
o
w
e
r
Frequency
Mu Rhythm: Does it Reflect Mirror Neuron
Activity?
Baseline
Move
Observe
Imagine
Pineda et al., IEEE Trans. Rehab. Engr., 2000, 8(2): 219-222
RELATIVE MU POWER (n=13)
150
% DIFFERENCE FROM BASELINE
125
100
*
75
**
50
25
0
BASELINE
VIDEO0
IMAGINE
VIDEO
CONDITIONS
DUCK
WATCH
Avikainen et al., NeuroReport, 1999, 10: 3467-3470
Cochin et al., Eur. J. Neurosci., 1999, 11: 1839-1842
Characterizing the System
generalizability?
motivational significance?
biological realism?
intentionality?
anthropomorphism?
transitive/intransitive actions?
Mu suppression
(biological actions)
social relevance?
learning?
No mu suppression
(non-biological actions)
Autism: A Dysfunctional Mirror System?

Autistic spectrum disorders are characterized by:





No common underlying mechanism has been identified


Impairments in social interaction
Delayed/abnormal language development
Impaired imagination
Repetitive and restricted patterns of behavior
Deficits in imitation learning – Rogers and Pennington, 1991
If mu rhythms reflect mirror neuron activity and the capacity to
imitate then autistics should show differences in mu rhythms
compared to controls
Experimental Paradigm

Measured mu power (2 min of
EEG) in normals (n=12) and
autistics (n=10) under different
conditions:



Self-movement of hand
Watching video of someone
moving their hand
Watching a video of a ball
moving up and down
Fraternal Twins
Normal
Autistic
The Root of Empathy?
“Understanding others as intentional agents
may be grounded in the relational nature of our
interactions with the world”

A Fundamental Organizational Feature of the Brain?

Beyond actions?



Audition and other senses
Emotions
Addiction?
What Is BCI?




Brain-based direct
communication
Extracting meaningful
patterns (signals)
Mapping signals to computer
commands
Integrated with keyboard,
mouse, and voice
recognition
BCI System
Feature
Extraction
0
Multichannel
10
(amplitude (dB) -->)
20
30
.
20 20log
X
j
40
50
60
70
80
j
(frequency (kHz) -->)
Interface
Technology
Data Acquisition
Pattern
Recognition
Mapping to
Keyboard
Commands
User
Application
BCI Use
Helping impaired individuals have greater mobility
Helping impaired individuals communicate
Augment average individual’s abilities
Recreational/entertainment purposes
A Brain-Computer Interface
Hypothesis
Learning to control brain rhythms is faster with
active engagement on the task, frequent
interactions, feedback, and connections to the real
world.
Strategies For High Mu





Imagining movement of hands, bike riding, playing
tennis or other athletic activity
Thinking about going right
Maintaining right movement in game
Focusing on word “right”
Shifting attention from word to direction
Strategies For Low Mu






Frustration
Math problems
Calming and relaxing body
Sad memories
Distraction
Exhaustion
Results
1400
Predictions
1200
1000
POWER
800
600
400
1400
200
1200
R = 0.9152
1000
POWER
0
2
LOW
HIGH
MU CONDITIONS
800
HIGH
600
400
LOW
200
R2 = 0.8909
0
S1
S2
S3
S4
S5
S6
TRAINING SESSIONS
Collaborators
Brendan Z. Allison
Eric L. Altschuler
Edward M. Hubbard
Joseph P. McCleery
Vilayanur S. Ramachandran
Lindsay M. Shenk
Andrey Vankov
Victor Wang