* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download Chaos and neural dynamics
Incomplete Nature wikipedia , lookup
Theta model wikipedia , lookup
Multielectrode array wikipedia , lookup
Clinical neurochemistry wikipedia , lookup
Behaviorism wikipedia , lookup
Neuromuscular junction wikipedia , lookup
Activity-dependent plasticity wikipedia , lookup
Holonomic brain theory wikipedia , lookup
Recurrent neural network wikipedia , lookup
Molecular neuroscience wikipedia , lookup
Synaptogenesis wikipedia , lookup
Neuroeconomics wikipedia , lookup
Premovement neuronal activity wikipedia , lookup
Microneurography wikipedia , lookup
Convolutional neural network wikipedia , lookup
Caridoid escape reaction wikipedia , lookup
Mirror neuron wikipedia , lookup
Neuroanatomy wikipedia , lookup
Stimulus (physiology) wikipedia , lookup
Neural engineering wikipedia , lookup
Synaptic noise wikipedia , lookup
Single-unit recording wikipedia , lookup
Types of artificial neural networks wikipedia , lookup
Neurotransmitter wikipedia , lookup
Neural modeling fields wikipedia , lookup
Neuroethology wikipedia , lookup
Neural oscillation wikipedia , lookup
Optogenetics wikipedia , lookup
Nonsynaptic plasticity wikipedia , lookup
Central pattern generator wikipedia , lookup
Feature detection (nervous system) wikipedia , lookup
Neural coding wikipedia , lookup
Chemical synapse wikipedia , lookup
Development of the nervous system wikipedia , lookup
Channelrhodopsin wikipedia , lookup
Neuropsychopharmacology wikipedia , lookup
Pre-Bötzinger complex wikipedia , lookup
Synaptic gating wikipedia , lookup
Nervous system network models wikipedia , lookup
Radiophysies and Quantum Electronics, Vol. 39, No. 6, 1996 CHAOS AND NEURAL DYNAMICS M . I. R a b i n o v i c h UDC 519.7 Small neural networks (central pattern generators}, which control rythmic behavior of animals, are considered. The mechanisms responsible for regularity, reliability, and plasticity of such behavior (swimming, running, walking, etc.) are analyzed. New data on the origin of regular cooperative behavior of neurons are obtained by using methods of nonlinear dynamics. 1. I N T R O D U C T I O N Exactly fifteen years ago, we had a talk with A. V. Gaponov and A. A. Andronov in Gaponov's room. We discussed the paper on "Using fractal dimension to analyze systems with chaotic behavior" written by me together with A. Ugodchikov, a graduent student, and F. Izrailev, a physicist from Novosibirsk [1]. In our talk, Andronov proposed to use fractal dimension in analysis of electroencephalograms. Should the dimension appear finite, or, more precisely, moderate, it could be assumed that apparent noisy encephalograms can be produced by a low-dimensional dynamic system. That idea seemed to be very attractive." I mentioned that such an idea was implemented at that time in connection with the analysis of electrocardiograms, and we also began studies in that field. Simultaneously, the paper by L. Glass and coauthors about chaotic dynamics of cardiac cells appeared in Science [4]. We also recollected R. May's papers dealing with chaotic dynamics of populations [5]. There, Gaponov asked a question which none of us could answer at that time: "What is chaos for living beings?" Years passed. Fate and Perestroika brought me and A. Selverston, an outstanding neurophysiologist, together at the University of California in San Diego. Our interest is not brain activity; we deal with much simpler objects, such as small nerve systems which are responsible for the motor rhythmic activity of organisms (the so-called "central rhythm generators.") And only now can I formulate the question that Andrey Victorovich asked then. I recollect that the question was "What for...?" rather than "Where from...?", that is, "What is the nature of dynamic chaos in biological systems?". The latter question, and the answer, might even seem too simple at present. Indeed, when we speak about the dynamic behavior of complex (having a large number of degrees of freedom) nonlinear nonequilibrium systems such as nerve systems or even one neuron, it is only a matter of technique to extract chaos generation mechanisms. Evidently, the question "Why...?" is associated with biological expediency, i.e., the question is about the reason why evolution retained dynamic chaos as a typical mode of behavior in large and small nerve systems. This question is much more difficult and ambiguous. Possibly, the obvious answer to this question is absent at present. "Such investigations are still performed at present in various research centers (see, e.g., [2, 3]). Institute of Applied Physics, Russian Academy of Sciences, Nizhny Novgorod. Translated from Izvestiya Vysshikh Uchebnykh Zavedenii, Radiofizika, Vol. 39, No. 6, pp. 757-770, June, 1996. Original article submitted May 30, 1996. 502 0033-8443/96/3906-0502515.00 Q1997 Plenum Publishing Corporation 2. P O I N T OF VIEW In my opinion, the answer to the question "Why...?" can be formulated as follows: Possibly, dynamic chaos in itself is not requisite to living systems. However, the wealth of regular modes in dynamic systems that are potentially able to generate chaos is obviously one of the main features which Nature realizes at the different levels of organization of nerve ensembles. In other words, it is not chaos itself that is critical to the normal operation of nerve structures but the fact that those structures work at the boundary (and, rather often, beyond the boundary) of instability. This gives them exclusively high adaptive possibilities, ensures rapid mode switching, and, of course, the variety itself of modes of behavior. To put it differently, dynamic chaos is the inevitable payment for the high adaptivity and versatile activity of nerve systems. Evolution developed a variety of methods to ensure self-control and self-monitoring of nerve ensembles composed of chaotic elements. On the one hand, these methods have all the advantages of unstable systems and of systems with complex dynamics (short time of transient processes, multiplicity of periodic and nonperiodic modes) and, on the other hand, they make the behavior of the systems predictable. In what follows, we will show how the above principles are implemented in small nerve syster~.s, using central r h y t h m generators as an example. 3. E X P E R I M E N T Let us discuss at first what progress has been achieved in this area for the last fifteen years and what key experiments can be used for the analysis. The main results in this avenue are associated with the analysis of the behavior of individual neurons and neural ensembles, which confirms that the dynamics of a collection of neurons is more regular than their individual dynamics. This is true also for small nerve systems such as central r h y t h m generators [6, 7] and cerebral cortex neurons [8, 9] where the role of separate elements of an ensemble is played by structures consisting of a large number of neurons connected by an "all with each" feature. Another important result, which follows from the recent (laboratory and model) experiments, consists in the following. Chaotic neurons in the ensemble not only order the behavior of each other but also change easily the mode of behavior (adaptivity) under the action of control parameters. Among such control parameters, we should include, for example, the coupling between neurons (which is determined by the concentration of neural mediators), temperature, etc. [10]. We now discuss some experiments. First of all, we illustrate the fact that indeed irregular pulsations of an individual neuron can be described by a low-dimensional dynamic system [11]. Figure 1 shows oscillograms of an LP neuron in a pyloric lobster r h y t h m generator. As the parameter I, we use an external current fed through a microelectrode to a living nerve cell. Fairly long neuron activity records were processed to calculate Lyapunov exponents, determine the m i n i m u m dimension of a dynamic system which is able to generate a similar signal (embedding dimension), etc. Figure 2 shows the phase portraits of a limiting set which were reconstructed by a temporal shift m e t h o d (see [12]). For I = 0 nA, I = - 1 nA, and I = - 2 nA, the reconstructed limiting set is a strange attractor. Calculations show that the embedding dimension is equal to three, while the Lyapunov dimension D~ = 2.75. It is clearly seen from Fig. 3 that only one Lyapunov exponent is positive: A+ ~ 0.8. It follows from the above data that indeed the individual dynamics of an LP neuron is chaotic and lowdimensional. To simulate such dynamics, we need only a three-dimensional dynamic system. An adequate mo,~! relating to this e ~ e is the model proposed by Hindmarsh and Rose in 1984 [13] and its various generalizations [14, 15]. In a simple version, the model equations are given by = y + az 2 -b~s - z + I, ~)=c-d~ 2-y, = r[s( - (1) z], r << 1, 503 (a) 1=2~A 0)) i.~r~ (c) I=OnA 1 SeC~ Fig. 1. Chaotic pulsation of the membrane potential of an LP lobster neuron as a function of external current. Here, z(t) is the membrane potential of a nerve cell, v(t) is a variable describing the reconstruction of fast ion densities (usually they are Na + and K+), and z(t) is a slow variable determined by the ion density Ca ++. For the parameter values a = 3, b = 5, I = 3.281, z0 = - 1 . 6 , s = 4.0, and r = 0.0021 this system generates the same chaotic sequences as a living neuron (Fig. 4), and a typical attractor in the phase space of system (1) (Fig. 5) has the same topology as the attractors reconstructed from the observed d a t a from a living neuron (Fig. 2). The domain of dynamic chaos is not so large in the parameter space of system (1). However, the main information which is important in our further analysis is that the regular motions that are potentially possible in this model are extremely varied. H o w will chaotic neurons (livingor simulated) behave when they are combined into a neural network? All depends on the form of coupling. It should be specified that the coupling between chaotic generators, which is considered by tradition in analysis of electron chains, chemical turbulence, etc., is usually dissipative or diffusional. This coupling is proportional to the mismatch of variables in coupled generators, e(z1(t) - z2(t)) (e is the coupling), and, of course, tends to decrease the error signal down to zero. If dissipative coupling is strong enough (compared to the divergence growth rate of chaotic trajectories),then chaotic generators are synchronized completely and operate as one chaotic generator [16, 17]. If coupling is weak, the chaotic synchronization mode z1(t) -= z2(t) is unstable, and the dynamics of the couple still increases in complexity: the number of positive Lyapunov exponents doubles, the dimension of the limiting chaotic set increases, and so on. Such electrical(dissipative)coupling is met also in neural networks (see review [18]). However, coupling via a chemical synapse is more typical. It is seen from the data presented in Figs. 6 [18] and 7 [11] that 504 I=lnA I=2n.A o~ 4 .7 .13 '7--.,._ Y ,| Z"" ~ " , .15 4 4 l=OnA . I =-InA 910 "'5"-.-./"" .tl j .3 -I0 I=-2 nA -t3 "2 Z .IO "~ Fig. 2. Phase portraits of a strange attractor reconstructed from a long temporal realization (~,- 2 mln) similar to Fig. 1. 1.5 1.0 0.5 I.I.I 0.0 -0.5 -1.0 "--1.5 - 0.0 I 10.0 ! 9 20.0 :30.0 Time (sec) 40.0 Fig. 3. Behavior of the Lyapunov exponents reconstructed from an oscillogram of a living LP neuron pharmacologically isolated from other neurons ( I = 0). the dynamics of an individual neuron is considerably more irregular than in a synaptically coupled pair in b o t h actual and simulated neuron pairs. It can be said that synaptic coupling suppresses chaos. This 505 v(o 2.0 1.0 0.0 -1.0 -2.0 0.0 10000.0 20000.0 30000.0 40000.0 50000.0 Time Fig. 4. Temporal realization generated by a dynamic system (1) (the parameters are given in the text.) 3.~ slo' ast motion -2 -2 ,2 ~ .6/.4. 2 x 0 "~,~ / . -8 "~'y Fig. 5. Typical attractor af system (1) (the case of a complex limit cycle.) phenomenon makes the dynamics of neuron ensembles radically different from, for example, the dynamics of the conventional networks of electron generators [19]. Synaptic coupling is nonlinear coupling which is characterized by the presence of threshold and saturation (a simple model of a chemical synapse can be expressed by a stepwise function in the "input-output" variables plane.) Such coupling (both exciting, which depolarizes the membrane of the nerve cell and suppressing, which hyperpolarizes that membrane) averages the irregular dynamics of spikes. It is exactly this averaging that results in chaos suppression in the case of mutual synaptic coupling between neurons. To illustrate the idea of adaptivity and variety of the behavior of neuron ensembles consisting of synapticaUy coupled chaotic elements, we give the results of one experiment with model neurons.* *Similar experiments with living neurons are conducted at present in A. Silverstone's laboratory. The preliminary results are encouraging. 506 raV 2O.0 10.0 0.0 1.0 2.0 3.0 4.0 5.0 6.0 7.0 8.0 Time (sec) Fig. 6. Irregular activity modes of model neurons in a system of two chaotic neurons coupled by mutual suppressing coupling: (1) oscillations with small phase shift; (2)in-phase oscillations (complete synchronization); (3) counterphase synchronization; (4) "almost" counterphase syncronization. 4.0 X1,2 X1.2 - Xl,2 - i 9 i . i 1.0 0.0 -1.0 -2.0 0.0 4.0 3.0 2.0 1.0 0.0 -1.0 -2.0 0.0 4.0 3.0 2.0 1.0 0.0 -1.0 -2.0 0,0 4.0 3.0 f 2.0 1.0 0,0 -1.0 -2.0 0.0 T i 2.0 f X1,2 ! i . i 9 ~ ~ I 100.0 200.0 300.0 400.0 500.0 600.0 700.0 100.0 200.0 300.0 400.0 500.0 600.0 700.0 9 i - 100.0 " ' 100.0 i - 200.0 " ' 200.0 i " Type II 300.0 " 'Typell' 300.0 / 400.0 ] 400.0 Time Fig. 7. Regular activity modes of model neurons in a system of two chaotic neurons coupled by mutual suppressing coupling: (1) oscillations with a small phase shift; (2) in-phase oscillations (complete synchronization); (3) counterphase synchronization; (4) "almost" counterphase synchronization. Consider the operation of a central cardiac rhythm generator in a medicinal leech. The block diagram of that central generator is shown in Fig. 8 [28]. We use the familiar model (1) to simulate the dynamics of an individual neuron. This model imitates well an actual neuron which produces a series of fast spikes against the background of slow and intense pulsations of the membrane potential (cf. Fig. 1). The basic result of the computer experiment is shown in Fig. 9 [21]. It is seen that the period of the central cardiac 507 Fig. 8. Block diagram of the central cardiac rhythm generator of a medicinal leech. Suppressing synaptic coupling is shown by black circles. 2.00 I period (sec) % % o t~ 1.50 o ,o n o . u o o 1.00 o . ;d o 0.50 oOQ 0 ...... 9 O.S 10 1.S 2.0 6 Fig. 9. Variation of the cardiac rhythm period in a model central generator consisting of chaotic neurons (Fig. 4) combined into chains as in Fig. 8. The synchronization is absent when the synaptic coupling ~ < 0.5. r h y t h m generator of a medicinal leech is very sensitive to the magnitude of synaptic coupling. The increase in coupling (which is possibly due to the change in neural mediator density) results in a stepwise increase of spikes in each oscillation period and the corresponding decrease of the cardiac pulsation r h y t h m . It is significant that in the neuron chain in question, the bifurcations inside the synchronization mode of chaotic neurons, which are observed when synaptic coupling is changed, resemble the bifurcations which are detected in the behavior of one neuron when its parameters are changed [22]. Thus, the potentialities of complex individual dynamics of a neuron do not go to waste but are used purposefully to ensure adaptation and control in the neuron ensemble. It has recently been shown in [23] that the results which we obtained are also valid when the form of the model is changed and even when the dimension of the model is increased. W h a t m a t t e r s is only that the model must show correctly the qualitative features of nerve cell activity, such as spike bursts and the dependence of a characteristic pulse period on external current (cf. Fig. 1). 508 4. R O L E O F N O I S E Clearly, it is extremely difficult to obtain long records of steady-state neuron activity, for example in the cerebrum, and process them carefully as was done for a lobster's LP neuron. Therefore, the nature of the irregular behavior of many species of neurons still remains unclear. In such a situation, it is no easy problem to find out the role of noise in the bahavior of small and large neuron ensembles. By the noise effect, we can also explain the irregular pulsation of neuron generators, especially if they operate in a mode close to generation threshold [24]. In connection with this, the question arises whether noise plays an efficiency role in the operation of neuron ensembles or it is simply "a launching trigger" which ensures the variety of instability mechanisms. Of course, the noise effect depends on a particular situation. However, it is difficult to conceive that combining noise generators into ensembles can result in ordering of their behavior as is the case with model chaotic neurons in the experiment. At the same time, if we assume that neurons are generators with complex dynamics, then we can predict two important effects due to noise. The point is that systems which are able to generate dynamic chaos possess a very complicated structure of the phase space. Besides the various attractors (periodic or strange), the nonattracting trajectories too play an important role in the variability of the dynamics of such systems. Among the latter, we should mention saddle-type limit cycles outside the attraction basins of attractors. Our experiments with a Hindmarsh-Rose system [11] (weak Gaussian noise was added to the right-hand side of Eqs. (1)) showed that the noise effect increases the dimension of a chaotic set and the Kolmogorov-Sinai entropy, which in turn enriches the spectrum of individual neuron behavior. When such neurons are combined into an ensemble with synaptic coupling, noise is to a considerable degree suppressed by the synchronization effect. However, the variability of the neuron behavior is retained. Another factor of the noise effect, which also seems to be obvious, is that noise kills, by averaging, a variety of "pathological" attractors which are characterized by small attraction basins in the phase space and are therefore "unrealiable in service" [11]. 5. CONCLUSION The question about the dynamic behavior of large neuron ensembles is especially interesting and complicated. Obviously, the dynamics of such ensembles is low-dimensional (except the cases of pathological synchronization observed in epilepsy). Such ensembles can produce both regular spatio-temporal patterns and spatio-temporal chaos. Of course, the cerebrum is not a low-dimensional dynamic system, and a different-dimensional analysis of electroencephalograms is of no radical importance from today's position. However, the approach to nerve ensembles from the position of nonlinear dynamics has already brought many challenging results and seems very promising today. Returning to the initial question, we stress once again that neither nature nor society need developed chaos. The diversity of forms of behavior of complex systems is the basis for existence of living creatures. REFERENCES 1. F. M. Izrailev, M. I. Rabinovich, and A. Ugodchikov, Phys. Lett. A, 68~ 321 (1981). 2. Proceedings of the Second Annual Conference on Nonlinear Dynamical Analysis of the EEG (B. H. Janssen and M. E. Brandt, eds.), World Scientific, Singapore (1993). 3. T. Elbert et al., Physiol. Rev. 74~ 1 (1994). 4. L. Glass, M. R. Quevara, and A. Shrier, Science, 214, 1350 (1981). 5. It. M. May, Stability and Complexity in Model Ecosystems, Princeton University Press, Princeton (1973). 6. P. Meyrand, J. Simmers, and M. Moulins, Nature, 351, 60 (1991). 7. Dynamic Biological Networks: The Stomatogastric Nervous System (R. M. Harris-Warrick, E. Marder, A. I. Selverston, and M. Moulins, eds.), MIT Press, Cambridge (1992). 509 8. 9. 10. 11. 12. 13. 14. 15. 16. 17. 18. 19. 20. 21. 22. 23. 24. D. Hansel and H. Sompolinsky, J. Comput. Neurosci., 3, 7 (1996). B. W. Connors, M. J. Gutnick, and D. A. Prince, J. Neurophysiol., 48, 1302 (1982). C. M. Armstrong, Physiol. Rev., 72~ 55 (1992). H. D. I. Abarbanel et al., Neural Comput., 8, 234 (1996). V. S. Afraimovich and A. I. Reiman, in: Nonliner Waves: Dynamics and Evolution (A. V. GaponovGrekhov and M. I. Rabinovich, eds.)[in Russian], Nauka, Moscow (1987). J. L. Hindmarsh and R. M. Rose, Proc. R. Soc. London., ]]221, 87 (1984). X. J. Wang and J. Pdnzel, in: The Handbook of Brain Theory and Neural Networks (A. Arbib, ed.), MIT Press, Cambridge (1995), p. 686. M. I. Rabinovich et al., Proc. Natl. Acad. Sci. USA, 1996 (in press). V. A. Afraimovich, N. N. Verichev, and M. I. Rabinovich, Izv. Vyssh. Uchebn. Zaved., Radiofiz., 29, 795 (1986). N. F. Rul'kov, Chaos, 1996 (in press). H. D. I. Abarbanel et al., Usp. Fiz. Nauk, 166, No. 4, (1996). V. S. Afraimovich, V. I. Nekorkin, G. V. Osipov, and V. D. Shalfeev, Instability, Structures and Chaos in Nonlinear Synchronization Networks [in Russian], IAP Press, Nizhny Novgorod (1989). R. L. CMabrese, F. Nadim, and O. H. Olsen, J. Neurobiol., 27, 390 (1995). M. I. Rabinovich et al., Neural Comput. (in press). R. Huerta, M. Bazhenov, and M. I. Rabinovich, Phys. Rev. E (in press). V. I. Mol'kov, M. I. Rabinovich, and M. M. Sushchik, in: Vestnik Nizhegorodskogo Universiteta (in press). "Proc. of the NATO Workshop on Stochastic Resonance and Biology" (F. M. Moss, A. Bulsara, and M. Shlesinger, eds.), J. Stat. Phys., Nos. 1 and 2 (1993). 510