* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download Down - 서울대 Biointelligence lab
Action potential wikipedia , lookup
Activity-dependent plasticity wikipedia , lookup
Theta model wikipedia , lookup
Neuromuscular junction wikipedia , lookup
Resting potential wikipedia , lookup
Neuroanatomy wikipedia , lookup
Recurrent neural network wikipedia , lookup
Mirror neuron wikipedia , lookup
Premovement neuronal activity wikipedia , lookup
Development of the nervous system wikipedia , lookup
Caridoid escape reaction wikipedia , lookup
Neural oscillation wikipedia , lookup
Holonomic brain theory wikipedia , lookup
Electrophysiology wikipedia , lookup
Molecular neuroscience wikipedia , lookup
Central pattern generator wikipedia , lookup
Convolutional neural network wikipedia , lookup
Neurotransmitter wikipedia , lookup
Synaptogenesis wikipedia , lookup
Optogenetics wikipedia , lookup
Feature detection (nervous system) wikipedia , lookup
End-plate potential wikipedia , lookup
Nonsynaptic plasticity wikipedia , lookup
Types of artificial neural networks wikipedia , lookup
Pre-Bötzinger complex wikipedia , lookup
Metastability in the brain wikipedia , lookup
Neural modeling fields wikipedia , lookup
Channelrhodopsin wikipedia , lookup
Stimulus (physiology) wikipedia , lookup
Neuropsychopharmacology wikipedia , lookup
Single-unit recording wikipedia , lookup
Chemical synapse wikipedia , lookup
Neural coding wikipedia , lookup
Synaptic gating wikipedia , lookup
3. Simplified Neuron and Population Models Fundamentals of Computational Neuroscience, T. P. Trappenberg, 2002. Lecture Notes on Brain and Computation Byoung-Tak Zhang Biointelligence Laboratory School of Computer Science and Engineering Graduate Programs in Cognitive Science, Brain Science and Bioinformatics Brain-Mind-Behavior Concentration Program Seoul National University E-mail: [email protected] This material is available online at http://bi.snu.ac.kr/ 1 Outline 3.1 3.2 3.3 3.4 3.5 Basic spiking neuron and population models Spike-time variability The neural code and the firing rate hypothesis Population dynamics Networks with non-classical synapses (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 2 3.1 Basic spiking neurons Conductance-based model is too heavy to a large network simulation Integrate-and-fire neuron model The form of spike generated by neuron is very stereotyped. The precise form of the spike does not carry information. The occurrence of spikes is important. The relevance of the timing of the spike for information transmission. Neglect the detailed ion-channel dynamics. (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 3 3.1.2 The leaky integrate-and-fire neuron du (t ) u (t ) RI (t ) (leaky itegrator) dt (3.2) I (t ) w j (t t jf ) (3.1) m Membrane potential, u j t Membrane time constant, m α function : f ( x) x exp( x) Input current, I (t ) (3.3) u (t f ) Synaptic efficiency, w j (3.4) lim u (t f ) u res Firing time of presynaptic neuron 0 of synapse j, t jf Firing time of the postsynaptic neuron, u (t f ) Firing threshold, Reset membrane potential, ures f j Absolute refractory time by holding this value (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr Fig. 3.1 Schematic illustration of a leaky integrate-and-fire neuron. This neuron model integrates(sums) the external input, with each channel weighted with a corresponding synaptic weighting factors wi, and produces an output spike if the membrane potential reaches a firing threshold. 3.1.2 Response of IF neurons to constant input current (1) Simple homogeneous differential equation, du (t ) Initial membrane potential 0 m u (t ) 0 dt u(t=0)=1. very short input pulse. (3.5) Equilibrium equation of the membrane potential after a constant current has been applied for a long time u(t ) e t / m (3.6) IF-neuron driven by a constant input current du u RI 0 Low enough to prevent the firing. (3.7) ut After some transient time, the membrane potential dose not change (3.8) The differential equation for constant input (current) for all times after the constant current Iext = const is applied: u (t ) RI (1 e t / m u (t 0) t / m e ) (3.9) RI Exponential decay of potential at u(t=0) (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 5 3.1.2 Response of IF neurons to constant input current (2) RI RI Fig. 3.2 Simulated spike trains and membrane potential of a leaky integrate-and-fire neuron. The threshold is set at 10 and indicated as a dashed line. (A) Constant input current of strength RI = 8, which is too small to elicit a spike. (B) Constant input current of strength RI = 12, strong enough to elicit spikes in regular intervals. Note that we did not include the form of the spike itself in the figure but simply reset the membrane potential while indicating that a spike occurred by plotting a dot in the upper figure. (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 6 3.1.3 Activation function The time tf is given by the time when the membrane reaches the firing thresholdu(t ) , t ln u RIRI (3.10) Activation or gain function define as the inverse of tf or the firing rate r (t ln u RIRI ) (3.11) f f m res 1 ref m res Absolute refractory time t ref This function quickly reaches an asymptotic linear behavior A threshold-linear function is often used to approximate the gain function of IF-neurons Fig. 3.3 Gain function of a leaky integrateand-fire neuron for several values of the reset potential ures and refractory time tref. (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 7 3.1.5 The Izhikevich neuron (1) A model which is computationally efficient while still being a ble to capture a large variety of the subthreshold dynamics of t he membrane potential. Subthreshold dynamics Firing and reset condition (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 8 3.1.5 The Izhikevich neuron (2) (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 9 3.2 Spike time variability Fig. 3.5 Normalized histogram of interspike intervals (ISIs). (A) data from recordings of one cortical cell (Brodmann’s area 46) that fired without task-relevant characteristics with an average firing rate of about 15 spikes/s. The coefficient of variation of the spike trains is Cv ≈ 1.09. (B) Simulated data from a Poisson distributed spike trains I which a Gaussian refractory time has been included. The solid line represents the probability density function of the exponential distribution when scaled to fit the normalized histogram of the spike train. Note hat the discrepancy for small interspike intervals is due to the inclusion of a refractory time. Neurons in brain do not fire regularly but seem extremely noisy. Neurons that are relatively inactive emit spikes with low frequencies that are very irregular. High-frequency responses to relevant stimuli are often not very regular. The coefficient of variation, Cv=σ/μ (3.18) Cv≈0.5-1 for regularly spiking neurons in V1 and MT Spike trains are often well approximated by Poisson process, Cv=1 (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 10 3.2.1 Biological irregularities Biological networks do not have the regularities of the engineering-like designs of the IF-neurons Consider irregularities from different sources in the biological nervous system The external input to the neuron Structural irregularities Use a statistical approach (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 11 3.2.2 Noise models for IF-neurons Noise in the neuron models Stochastic threshold (1) (t ) (3.22) Random reset u res u res ( 2) (t ) (3.23) Noisy integration m du u RI ext (3) (t ) (3.24) dt The stochastic process of a neuron Appropriate choices for the random variables η(1), η(2), and η(3). Fig. 3.6 Three different noise models of I&F neurons (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 12 3.2.3 Simulating variabilitiy of real neurons(1) The appropriate choice of the random process, probability distribution, time scale Cannot give general anwers Fit experimental data Noise in IF model by noisy input. I ext I ext with N (0,1) (3.25) Central limit theorem Lognormal distribution pdf lognormal ( x; , ) 1 x 2 (log(x ) ) 2 e 2 2 (3.26) (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr Fig. 3.7 Simulated interspike interval (ISI) distribution of a leaky IF-neuron with the threshold 10 and time constant τm=10. The underlying spike train was generated with noisy input around the mean value RI = 12. The fluctuation were therefore distributed with a standard normal distribution. The resulting ISI histogram is well approximated by a lognormal distribution (solid line). The coefficient of variation of the simulated spike train is Cv ≈ 0.43 13 3.2.3 Simulating variabilitiy of real neurons(2) Simulation of an IF-neuron that has no internal noise but is driven by 500 independent incoming Poisson spike trains. EPSP amplitude w=0.5 Firing threshold (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr w=0.25 Fig. 3.8 Simulation of IF-neuron that has no internal noise but is driven by 500 independent incoming spike trains with a corrected Poisson distribution. (A) The sums of the EPSPs, simulated by an α-function for each incoming spike with amplitude w = 0.5 for the upper curve and w = 0.25 for the lower curve. The firing threshold for the neuron is indicated by the dashed line. The ISI histograms from the corresponding simulations are plotted in (B) for the neuron with EPSP amplitude of w = 0.5 and in (C) for the neuron with EPSP amplitude of w = 0.25. 14 3.2.4 The activation function depends on input The activation function of the neuron depends on the variations in the input spike train. The average firing rate for a stochastic IF-neuron [Tuckewell, 1988] r (t ref m ( R I ext ) / ( u res R I ext ) / eu [1 erf (u)du) 1 2 r r ( , ,...) (3.28) (3.27) mean : R I variance : low σ: sharp transition high σ: linearized Fig. 3.9 The gain function of an IFneuron that is driven by an external current that is given a normal distribution with mean μ=RI and variance σ. The reset potential was set to Ures = 5 and the firing threshold of the IF-neuron was set to 10. The three curves correspond to three different variance parameters σ. (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 15 3.3 The neural code and the firing rate hypothesis (1) Firing rate of sensory neurons increase considerably in a short time interval following the presentation of an effective stimul us to the recorded neurons. The stretch receptor on the frog muscle (Fig. 3.10) (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 16 3.3 The neural code and the firing rate hypothesis (2) The tuning curve of simple cells (Fig. 3.11) Other parts of spike patterns can convey information (sec. 3.3.1-2) (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 17 3.3.1 Coreelations codes and coincidence detectors (1) Co-occurrence of the spikes of the two neurons, but no signif icant variation of the firing rate in them. (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 18 3.3.1 Coreelations codes and coincidence detectors (2) Temporal proximities(coincidence) of spikes can make a difference in the information processing of the brain. can be detected by leaky integrator neurons. (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 19 3.3.2 How accurate is spike timing It is widely held belief that neural spiking is not very reliable, and that there is a lot of variability in neuronal responses (Fig . 3.13A). Populations of neuron can rapidly convey information in a ne ural network (Fig. 3.13B). (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 20 3.4 Population dynamics: modelling the av erage behavior of neurons Many of the models in computational neuroscience, in particu lar on a cognitive level, are based on descriptions that do no ta ke the individual spikes of neurons into account, but instead d escribe the average activity of neurons or neuronal population s. (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 21 3.4.1 Firing rates and population averages (1) Estimating firing rate of a single neuron with a kernel function (or window) With rectangular window With Gaussian window (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 22 3.4.1 Firing rates and population averages (2) Estimating average population activity of neurons (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 23 3.4.2 Population dynamics for slow varyin g input Population dynamics τ : membrane time constant g : population activation function Derived from (Eq. 3.41) Stationary state (dA/dt=0) (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 24 3.4.4 Rapid response of populations Very short time constants, much shorter than typical membran e time constants, have to be considered when using Eq. 3.37 t o approximate the dynamics of population response to rapidly varying inputs. (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 25 3.4.5 Common activation functions (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 26 3.5 Networks with non-classical synapses: the sigma-pi node We assumed additive(linear) characteristics of synaptic curren ts. However, single neurons show also non-linear interactions bet ween different inputs. (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 27 3.5.1 Logical AND sigma-pi nodes Only if two spikes are present within the time interval, on the order of the decay time of EPSPs, can a postsynaptic spike be generated. For the population model, the probability of having two spike s of two different presynaptic neurons in the same interval is p roportional to the product of the two individual probabilities. The activation of node i (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 28 3.5.2 Divisive inhibition Shunting inhibition (Fig. 3.19A) (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 29 3.5.3 Further sources of modulatory effects between synaptic inputs NMDA synapse The blockade of NMDA receptors is removed if membrane pote ntial is raised by EPSP from another non-NMDA synapse in its proximity (Fig. 3.19B) Afferent modulation Direct influence of specific afferents on the release of neurotran smitters by presynaptic terminals (Fig. 3.18C) (C)(C) 2009 2009 SNU SNU CSE CSBiointelligence BiointelligenceLab, Lab http://bi.snu.ac.kr 30