Download 11 Music and Language

Survey
yes no Was this document useful for you?
   Thank you for your participation!

* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project

Document related concepts
no text concepts found
Transcript
PERCEPTION OF MUSIC
& LANGUAGE
Music Perception
• Musical notes
– Sounds of music extend across frequency
range: 25–4200 Hz
– To increase by one octave double the frequency
– Intervals that sound good together have
overlapping harmonic frequencies
Anthony J Greene
2
Music Perception
Anthony J Greene
3
Music Perception
•Tone height: A sound quality
whereby a sound is heard to be of
higher or lower pitch;
monotonically related to frequency
•Tone chroma: A sound quality
shared by tones that have the
same octave interval
•Musical helix: Can help
visualize musical pitch
Anthony J Greene
4
Music Perception
• Rhythm: Not just in music
– Lots of activities have rhythm: Walking,
waving, finger tapping, heartbeat, breathing,
etc.
– More examples: Car, train rides
Anthony J Greene
5
Speech Perception
1. Cortical Areas For Speech Perception and
Production
2. Phonemes
•
•
Articulation
Forment transitions
3. Speech Segmentation
4. Intonation & Prosidy
Anthony J Greene
6
Broca’s Area & Wernicke’s Area
Anthony J Greene
7
Aphasia
• Broca's aphasics produce slow, halting speech that is rarely
grammatical. They generally retain their vocabularies and
have no difficulty naming objects or performing other
meaning-related tasks. In general, they can deduce the
meanings of sentences from general knowledge, but cannot
understand sentences whose syntax is essential to their
meaning.
• Wernicke's aphasics are able to produce generally
grammatical sentences, but they are often nonsensical and
include invented words. Wernicke's aphasics show few
signs of understanding others' speech, and have difficulty
naming objects.
Anthony J Greene
8
Phonemes - The auditory
components of speech
• 43 Phonemes
• An alphabet for spoken language -- nondecomposable
• All sounds English words can be built from
a combination of phonemes
Anthony J Greene
9
Articulation: Consonants
1 Place of articulation:
–
–
–
Lips: b, p, m
Alveolar ridge: d, t, n
Soft palate: g, k, ng
Anthony J Greene
10
Articulation: Consonants
2 Manner of Articulation:
–
–
–
–
–
Totally obstructed: b, p, d, t, g, k
Partially obstructed: s, z, f, v, th, sh
Slightly obstructed: l, r, w, y
Initially obstructed: ch, j
Nasals: n, m, ng
Anthony J Greene
11
Articulation: Consonants
3 Voicing:
–
–
Voiced: b, m ,z, l, r
Voiceless: p, s, ch
Anthony J Greene
12
Articulation: Vowels
Front Vowels
Central Vowels
beet
about
bit
but
bait
bet
Diphthongs
at
bite
boy
Back Vowels
bough
boot
book
boat
cause
cot
Anthony J Greene
13
Recognizing
Phonemes
1 Place of
articulation:
Front
Anthony J Greene
Middle
Back
14
Obstructed
Recognizing
Phonemes
2 Manner of
articulation:
Unobstructed
Anthony J Greene
15
Recognizing
Phonemes
3 Voicing:
Anthony J Greene
16
Recognizing
Phonemes
Vowels
Anthony J Greene
17
Recognizing
Phonemes
Vowels
Anthony J Greene
18
Speech Segmentation
• The problem of determining which phonemes are
to be grouped into words before you know what
has been said
Anthony J Greene
19
Anthony J Greene
20
Speech Segmentation
• Appears to be largely a function of context,
learning common phoneme groupings, common
segmentations and familiar phrases
Anthony J Greene
21
Speech Segmentation
• Appears to be largely a function of context,
learning common phoneme groupings, common
segmentations and familiar phrases
• "I owe you a yo-yo". "Mares eat oats and does eat
oats, and little lambs eat ivy, a kid'll eat ivy too,
wouldn't you?"
Anthony J Greene
22
Spectrogram:
I owe you
a yo-yo
Anthony J Greene
23
Speech Segmentation (cont.)
• When speaking with someone who doesn't
understand what you just said, or with a young
child, we tend to put audible spaces between
words in order to assist segmentation
• Many errors of speech perception occur because
of improper segmentation - " 'scuse me while I
kiss the sky" - or with one phoneme shift -" 'scuse
me while I kiss this guy".
Anthony J Greene
24
Intonation & Prosidy
• Meaning is carried in intonation
"Oh yeah, that course is Great"
or
"That's it, you're finished”
• Prosidy is not only distinct behaviorally, but
neuropsychologically as well
Anthony J Greene
25
Language Acquisition
Discernable speech
sounds require
reinforcement:
Retroflex
Consonant
Anthony J Greene
26
Language Acquisition
Universal Grammar Associative Learning
Nativism
Empiricism
Noam Chomsky
B.F. Skinner
Experience is
insufficient
Experience is sufficient
Anthony J Greene
27
Universal Grammar
• Critical Period
• Human Specific Behavior
• The structure of syntax: The case for
generative grammar
• Insufficiency of Experience
• Creoles & ASL
Anthony J Greene
28
Associative Learning and Language
• While language is a remarkable capacity, a
predilection for language acquisition does
not imply a “universal grammar”
• Purely associative neural network models
can learn language and do so remarkably
similarly to humans
Anthony J Greene
29
Resolution of The Debate
• Ethology: The Ecological Perspective for
Learning: Conrad Lorenz
• Prepared and Unprepared Learning
• Nativism Vs. Empiricism Redux: Language
acquisition, as with other learning is
associative (empiricism),but occurs within
systems adapted for certain types of
acquisition (nativism)
Anthony J Greene
30