Download The Frame of Cognitive Pattern Recognition

Proceedings of the 26th Chinese Control Conference
July 26-31, 2007, Zhangjiajie, Hunan, China
The Frame of Cognitive Pattern Recognition
Pi Youguo1, Shu Huailin2, Liang Tiancai1
1. College of Automatic Science & Engineering, South China University of Technology, Guangzhou 510641, P.R.China
E-mail: [email protected]
2. College of Information, Guang Zhou University , Guangzhou 510091, P.R.China
E-mail: [email protected]
Abstract: Cognitive pattern recognition has two basic research problem , one is to understand principle of human pattern
recognition, and the other is to develop computer recognition system which has certain learning ability and adaptive ability
based on principle of human pattern recognition. Some achievement of pattern recognition in cognitive science was present ,
the frame of tradition machine pattern recognition was described. How to apply achievement of cognitive science to
traditional machine pattern recognition by combining with characteristic of machine pattern recognition was discussed.
Recognition of printed digit character was performed according to frame of cognitive pattern recognition, and the frame is
supported by the result of experiment.
Key Words: cognitive system; architecture; pattern recognition
time. Pattern recognition confirm certain pattern and
distinguish others patterns. Cognitive psychology
define recognition of exterior object acting on human as
pattern recognition, which match input-information with
information of long term memory, then make decision
about how to classify input-information into certain
known pattern[4]. The whole process of pattern recognition
include a series of step, sense, analysis, comparer,
decision-making, output, and so on. As for some pattern
which could not be found in long term memory, the result
of decision-making will be unknown, but tutor may help
process of pattern recognition learn new knowledge and
add new pattern into long term memory.
1 INTRODUCTION
Human being capture outer pattern by sensor organ and
perform recognition of the outer world by a series of
brain cognitive process. Pattern recognition is a basic
brain function for human beings, its research includes:
how the brain recognizes an object, and how human
beings perform pattern recognition for given
assignment. The former belongs to cognitive science,
and the latter belongs to information science. Property
of subject result in that cognitive science and
informational science had to be interdisciplinary
collaboration in research.
However, cognitive science and informational science
were founded at about the same period, cognitive
psychology was founded in the 1950s[1], informational
science was founded in the 1960s. Machine Pattern
Recognition did not benefit much from cognitive
psychology. After development of half century ,
cognitive science had made great progress in perceptive
understanding, and method of apperception, utilization
of wholes and parts, theory of templates and prototypes,
characteristic matching model, memory, and objective
background[2]. Although there are some disputation in
cognitive science, which did not prevent us from
building the model of machine pattern recognition
basing on cognitive science, or perform pattern
recognition with breakthroughs of cognitive science[3] .
Therefore, cognitive science will contribute to the
development of machine pattern recognition.
This paper is organized as follows. the major
achievement of pattern recognition in cognitive
psychology is discussed in Section 2, the model of
traditional pattern recognition is described Section 3,
the model of cognitive pattern recognition is presented
Section 4, and the conclusions is at the end of paper.
2.1
Matching
Cognitive psychology has three major matching theory,
template matching theory, prototype matching theory,
feature matching theory.
Template matching theory point out that mini copy of
all kinds of patterns, that is template, was stored in
human long term memory. All template corresponding
to exterior simulation one by one. When one simulation
act on sensory organ, brain will translate stimulative
information into coding and compared stimulative
information with template in long term memory, then
make decision about which template will be optimum
matching for stimulative information.
Prototype theory think that prototype but not template
which corresponding to exterior pattern one by one was
stored in long term memory, any complicated pattern
was made up of prototype.
When one stimulation act on sensory organ, brain will
split stimulative information into prototype coding and
match with prototype which was stored in long term
memory.
Feature theory believe that pattern was made up of
some elements or component according to certain
principle. All elements or components and their
relationship was called feature. Exterior stimulation
consist of some distinguishable and independent feature,
so recognition may be performed by matching exterior
2 THE MAJOR ACHIEVEMENT OF
RECOGNITION IN COGNITIVE
PSYCHOLOGY
Pattern refer to combination of stimulation in space and
694
Authorized licensed use limited to: GUILIN UNIVERSITY OF ELECTRONIC TECHNOLOGY. Downloaded on October 4, 2008 at 22:53 from IEEE Xplore. Restrictions apply.
fall into two basic method: statistical pattern
recognition and syntax pattern recognition.
Syntax pattern recognition based on characteristic of
graphic structure, accomplish work according to tree
information of subschema. Some research indicated that
the nondirectional chain code of beeline is not
context-irrespective language[3]. The native syntax
method has defect in recognition because of the
difficult on linguistic analysis of context-irrespective
language. Statistical Pattern Recognition based on class
probability density function of sample in feature space,
combine Bayes decision-making system to practice
pattern recognition. It is also called decision-making
recognition method[4].
As far as technology concerned, the whole process of
machine pattern recognition need to pass through
pattern space, feature space and style space. From
above procedure, which can be conclude that machine
pattern recognition fall into three steps(as in Fig.1):
pattern collection, feature extraction , pattern
classification.
stimulation with feature stored in long term memory.
2.2
Perception and its Processing Way
Cognitive procedure include information-getting and
information-processing. Cognitive psychology regard a
great deal cognitive procedure as perceptional
procedure. Perceptional procedure receive sensory
input and translate sensory input into abstract coding
with two processing way, from top to bottom and from
bottom to top[1].
From bottom to top emphasize that exterior stimulation
is the source of process. From top to bottom emphasize
that certain knowledge produce perceptional process.
The former was called data driver process, the later was
called conception driver process.
The another important problem of perceptional
procedure is the relation between the whole and the part.
In 1977, Navon, based on his research, pointed out that
perception of whole feature faster than partial feature,
at the same time, partial feature did not work on
perceptional process when somebody paid attention to
whole feature consciously. However, people had to
perceive whole feature before he or she paid attention
to partial feature. Therefore, the sequence of
perceptional process is whole feature first.
2.3
Memory
Fig.1
Cognitive psychology describe memorial procedure as
three phase,sense memory, short term memory, long
term memory. During memory procedure, a great deal
of information will lose between any phase of transfer.
Only a small quantity of sensorial information can be
passed into short term memory. Information is
processed and coded in phase of short term memory
and then is pass into long term memory. Certainly, only
information passed into long term memory can be
memorized by brain, and those uncoded information
will be leaved soon.
2.4
Pattern collection need choose different transducer
according to object recognized in future, such as
measure equipment. Feature extraction convert pattern
space to feature space, and compress dimension.
Classifier can classify unknown sample into the right
style. It is necessary to confirm evaluative rule for the
design of classier, and train classier for more effective
classification.
4
Objiect Background and Dominance Effect
THE RESEARCH IN ARCHITECTURE
OF COGNITIVE PATTERN RECOGNITION
4.1 The Application in Matching Theory of Cognitive
Science
During coded procedure of memorial phase, people try
to combine new information with known information in
order to make new information enter into long term
memory. Some psychologic experiment show that long
term memory will accept knowledge correspong to real
experience faster than others knowledge.
During the procedure of pattern recognition, if some
background information was stored in long term
memory,
dominance
effect
which
act
on
decision-making strongly may come into being. For
example, it is difficult to confirm numericĀ0āor letter
Āoā when computer perform recognition of single
character þo ÿ . However, it is easy to recognize
character Āoā when character Āoā was presented
with numerical string or word.
3
The architecture of machine pattern recognition
Traditional machine pattern recognition had ever
adopted template matching theory to perform pattern
recognition ,but feature theory was employed most.
Whatever template theory or prototype theory or feature
theory, they all are descriptive method of object in
application of machine pattern recognition, and have
the same essence. Whether prototype is the descriptive
method of feature, Whether prototype is the partial
template of object, Whether feature is the descriptive
method of prototype, Whether template is the
descriptive method of feature. All above are the
controversy of different science viewpoint in cognitive
psychology. Anyway, our research need only be
satisfied with descriptive requirement of research object.
For certain target of convenience, the following
discussion take template for prototype.
THE ARCHITECTURE OF MATCHING
PATTERN RECOGNITION
The tranditional machine pattern recognition generally
695
Authorized licensed use limited to: GUILIN UNIVERSITY OF ELECTRONIC TECHNOLOGY. Downloaded on October 4, 2008 at 22:53 from IEEE Xplore. Restrictions apply.
4.2
can extend easily by adding new feature or prototype to
it. Storeroom of knowledge and regulation also act as
long-time memory. This storeroom store prior knowledge,
combinational regulation of prototype, feature relation
and so on.During the sector of matching decisionmaking, the result of pattern analysis will try to
compare with feature/prototype which were picked up
in storeroom of feature and prototype and knowledge/
regulation which were picked up in storeroom of
knowledge and regulation. Then decision-making
system will evaluate the result of comparison and
output the recognized conclusion. If matching fail , the
decision-making system will add relative feature and
prototype into corresponding storeroom automatically,
which make system learn new knowledge and store
new content.
Application of Memory Theory
Cognitive psychology describe the memorial procedure
as three phase,sensory memory, short-term memory,
and long-term memory. However, the procedure of
machine pattern recognition only has two phase, one of
phase is to collect information of the outer world by
transducer and keep information in computer. Long
term memory can hold feature or prototype and
knowledge or rule. Storeroom of feature/prototype and
storeroom of knowledge/rule can be build according to
long term memory theory. Traditional pattern recognition
always defuse to recognize model of short-term
memory. But cognitive pattern recognition will add
model of short-term memory into relevant storeroom if
corresponding model can not be found in storeroom of
feature/prototype. If relationship, structure, method or
any knowledge can not be found in storeroom of
knowledge/rule, these knowledge will be append to
relevant storeroom by simulating human learning
function.
4.3
5 CONCLUSION
The model of cognitive pattern recognition derive from
model of traditional pattern recognition. Pattern
analysis deal with extraction of feature, disassembly of
prototype, judgement of whole topological structure,
description of feature’s or prototype’s combinational
structure, and characterization of background.
Storeroom of knowledge/rule keep prior knowledge,
combinational rule of prototype, and knowledge of
feature relation and so on. Matching decision-making
match the result of pattern analysis with correlative
knowledge or rule come from storeroom of
feature/prototype and storeroom of knowledge/rule, and
then the matching result is processed according to
decision-making rule.
The Architectureof Cognitive Pattern Recognition
The model cognitive pattern recognition was showed
in Fig.2,pattern collection of the cognitive pattern
recognition just as what traditional machine pattern
recognition can do. Pattern analysis of cognitive pattern
recognition has more function than traditional pattern
recognition, which can analyse pattern stimulation
come from real world. The function of pattern analysis
includes feature extraction , prototype disassemble,
judgment of integral topology structure, combinational
description of feature or prototype, and background
description. Certainly, all above function work for
information search ,feature/prototype search, and
matching decision.
REFERENCES
[1]
[2]
[3]
[4]
Fig.2
The architecture of machine pattern recognition
Storeroom of feature and prototype just like long-time
memory,store feature or prototype of external object, and
Nisser.U.Cognitive Psychology[M].New York: NY: AppletonCentury-Crofts, 1967.
Wang. S.G. Frame of pattern recognition Model Based on
Cognitive psychology [J].Transaction on Wuhan university,
Information Science Edition. 2002,27(5): 543-547.
Zhou. G.X. Structure and method of computer pattern
recognition [M]. Wuhan, Middle China University of
Science and Technology Press. 1987.
Rueda L .G., Oommen B.J. On optimal pairwise linear
classifiers for normal distributions: the twoˉdimensional
case [J]. Pattern Analysis and Machine Intelligence, IEEE
Transactions on , 2002˗24(2): 274̚280.
696
Authorized licensed use limited to: GUILIN UNIVERSITY OF ELECTRONIC TECHNOLOGY. Downloaded on October 4, 2008 at 22:53 from IEEE Xplore. Restrictions apply.