Download 01 BIA - History - VŠB-TUO

NAVY Research Group Department of Computer Science Faculty of Electrical Engineering and Computer Science VŠB-­‐TUO 17. listopadu 15 708 33 Ostrava-­‐Poruba Czech Republic!
Basics of Modern Computer Science
Evolutionary Algorithms
History of Computers, Programming and its Future
Ivan Zelinka
MBCS CIPT, www.bcs.org/
http://www.springer.com/series/10624
Department of Computer Science
Faculty of Electrical Engineering and Computer Science, VŠB-TUO
17. listopadu 15 , 708 33 Ostrava-Poruba
Czech Republic
www.ivanzelinka.eu
Topics
• 
• 
• 
• 
• 
• 
• 
History of Computer technology from ancient time till today
Mechanical computers
The first programmable computers
Electromechanical computers
Computers and nature inspired algorithms
Historical facts about true “fathers” of nature inspired algorithms
Future computing technologies
2!
navy.cs.vsb.cz!
Objectives
The objectives of the lesson are:
•  Historical background of computational technologies and its
development.
•  Computers and nature inspired algorithms.
–  To show that John Holland was not the first researcher who come with
the idea of genetic algorithms.
–  That “father” of genetic algorithms is British mathematician A.M. Turing.
–  That 20 years before J. Holland the first numerical simulations of
evolution were done – genetic algorithms on computers.
•  Sketch future computational technologies and methods.
3!
navy.cs.vsb.cz!
Antiquity
4!
navy.cs.vsb.cz!
Historical facts... •  Machine of Antikythera Heron of Alexandria (theater, machines,
steam engine ...) Rome and his machine…
•  Banu Musov (9th century. Baghdad, Kitab al Hijál - Book on
sophisticated equipment or by mechanical devices), the supply of
hot and cold water, floating excavator to collect diamonds, oil lamp
wick automatic leveling…
•  Self-propelled mechanisms primitive robotics of Leonardo da Vinci,
Charles Baggage and Ada Byron…
5!
navy.cs.vsb.cz!
An8kythera Machine •  Machine of Antikythera (ancient ship 100 BC), 1900.
•  V. Statis, dr. Solla Price 1954), 40 rounds, astrolabe complex,
complicated, even though the format handheld device with many
clever transfers, which has been able to determine, inter alia, the
mere manipulation of dials all year round sunsets and bright stars,
the Sun, the Moon and the known planets.
•  Gemini astronomer, around 77 BC on the island of Rhodes.
•  Primitive calculator machine was constructed in 1652 by Blaise
Pascal.
•  It was followed by other inventors, but perfection comparable with
the astrolabe reached to F. Hahn in 1770.
6!
navy.cs.vsb.cz!
Another Mechanism • 
• 
• 
• 
• 
• 
Archimedes odometer.
Stesibius clocks.
Water automat (Heron of Alexandria).
Automatic doors (Heron of Alexandria).
Automatic theatre (Heron of Alexandria).
Heron steam ball - antique steam engine 2,000 years ago?
7!
navy.cs.vsb.cz!
Middle Ages
8!
navy.cs.vsb.cz!
The Alchemy and Robots •  Human effort to build machines that have a certain level of
intelligence is basically as old as our civilization.
•  In earlier times, was used word „slave“ not a „machine“; compare
„computers“ at the beginning of 20th century.
•  These beings could be included under the name of „homunkulus“ in
which production, there are many different recipes.
9!
navy.cs.vsb.cz!
The First Mechanical Calculator? •  Blaise Pascal is one of the inventors of the mechanical calculator in
the early 17th Century. Pascal made his invention in 1642.
•  First called the Arithmetic Machine, Pascal's Calculator and later
Pascaline.
•  Pascal went through 50 prototypes before presenting his first
machine to the public in 1645.
10!
navy.cs.vsb.cz!
Renaissance and Victorian Era
11!
navy.cs.vsb.cz!
Program-­‐Controlled Machine •  The Jacquard loom is a mechanical loom, invented by Joseph Marie
Jacquard, firstly demonstrated in 1801.
•  It was programmable machine by special cards to process of
manufacturing textiles with complex patterns such as brocade,
damask and another textile.
12!
navy.cs.vsb.cz!
Computer Powered by Steam
Difference Engine
•  Charles Babagge, 26.12.1791 - 18.10.1871.
•  Difference engine is an automatic mechanical calculator designed to
tabulate polynomial functions.
•  Consists of 8,000 parts, weighs five tons, and measures 11 feet
long.
•  See http://www.computerhistory.org/babbage/ .
13!
navy.cs.vsb.cz!
Computer Powered by Steam
Analytical Engine
•  Charles Babagge, 26.12.1791 - 18.10.1871.
•  Analytical engine - a general-purpose programmable computing
engine.
•  The logical structure of the Analytical Engine was essentially the
same as the one which has dominated computer design in the
electronic era - the separation of the memory (the 'Store') from
the central processor (the 'Mill'), serial operation using a 'fetchexecute cycle', and facilities for inputting and outputting data
and instructions.
•  Calling Babbage „the first computer pioneer“ is not a casual tribute.
14!
navy.cs.vsb.cz!
Augusta Ada King
•  She is mainly known for having written a description of Charles
Babbage's early mechanical general-purpose computer, the
Analytical Engine.
•  Today she is appreciated as the "first programmer" since she was
writing programs - that is, encoding an algorithm in a form to be
processed by a machine - for a machine that Babbage had not yet
built.
•  She also foresaw the capability of computers to go beyond mere
calculating or number-crunching while others, including Babbage
himself, focused only on these capabilities.
15!
navy.cs.vsb.cz!
20th century
16!
navy.cs.vsb.cz!
Zuse Z3
•  The Z3 was an electromechanical computer designed by Konrad
Zuse.
•  It was the world's first working programmable, fully automatic
digital computer.
•  The Z3 was built with 2000 relays, implementing a 22-bit words that
operated at a clock frequency of about 5–10 Hz. Program code and
data were stored on punched film.
•  The Z3 was completed in Berlin in 1941.
•  Thanks to this machine and its predecessors, Konrad Zuse is often
regarded as the inventor of the computer.
17!
navy.cs.vsb.cz!
Zuse Z3
Zuse Z3 replica on display at Deutsches Museum in Munich 18!
navy.cs.vsb.cz!
The Colossus Computer
•  The Colossus was the world's first electronic digital computer that
was fully programmable.
•  The Colossus computers were developed for British codebreakers
during World War II to help in the cryptanalysis of the Lorenz cipher.
•  Designed by the engineer Tommy Flowers to solve a problem posed
by mathematician Max Newman at the Government Code and
Cypher School (GC&CS) at Bletchley Park.
•  The prototype, Colossus Mark 1, was shown to be working in
December 1943 and was operational at Bletchley Park by 5 February
1944.
•  Ten Colossi were in use by the end of the war.
19!
navy.cs.vsb.cz!
The Bombe Computer
•  Turing's machine that helped decode Enigma was the
electromechanical Bombe, not Colossus.
•  The bombe was an electromechanical device used by British
cryptologists to help decipher German Enigma-machine-encrypted
secret messages during World War II.
•  It was a substantial development from a device that had been
designed in 1938 by Polish Cipher Bureau cryptologist Marian
Rejewski.
•  The bombe was designed to discover some of the daily settings of
the Enigma machines.
20!
navy.cs.vsb.cz!
The Colossus and Bombe
The Bombe computer. The Colossus computer. 21!
navy.cs.vsb.cz!
Altair Computer
•  MITS Altair 8800 is a microcomputer designed in 1975 based on the
Intel 8080 CPU.
•  The Altair is widely recognized as the spark that ignited the
microcomputer revolution.
•  It was expected to sell a few
hundred build-it-yourself kits to
hobbyists, and surprised producer when
they sold thousands in the first month.
•  The computer bus designed for the Altair
was to become a de facto standard in
the form of the S-100 bus, and the
first programming language for the
machine was Microsoft's founding
product, Altair BASIC.
22!
navy.cs.vsb.cz!
Altair Computer
23!
navy.cs.vsb.cz!
Modern Computers •  Nowadays there are many computer centers, working on the basis
of coupled parallel computers. In this consequences we also speak
about the so-called "grid computing„ , „cloud computing“ or "high
performance computing" (HPC).
•  As an example, an older set of one thousand PC with a Pentium II
processor running at 350 MHz and 64 Mbyte RAM OS running on
Red Hat Linux 6.0.
•  It is a configuration of Beowulf (see also
http://www.beowulf.org/overview/index.html.
•  Overview about modern HPC can be found at
http://www.top500.org/.
•  IT4 Innovations, VSB-TU Ostrava
http://www.it4i.cz/?lang=en .
•  PRACE http://www.prace-ri.eu/?lang=en .
24!
navy.cs.vsb.cz!
Modern Computers •  PRACE in a few words.
•  PRACE (Partnership for Advanced Computing in Europe) is to enable
high impact scientific discovery and engineering research and
development.
25!
navy.cs.vsb.cz!
Modern Computers 26!
navy.cs.vsb.cz!
Computers and Nature inspired Algorithms •  Top of the history of evolutionary algorithms usually dates back to
the mid-70s (Holland, 1975), when genetic algorithms were
introduced, possibly in the mid 60s when they were successfully
used in the evolutionary strategies (Rechenberg, 1973) (Schwefel ,
1977).
•  However, taking all the facts into account, it is safe to say that the
spiritual father of evolutionary computation techniques are such
personalities as mathematician A.M. Turing, N.A. Barricelli and
others.
•  Already at that time principles, which clearly describe the principles
of modern algorithms, were formulated and defined. It was not
programmatically realized, probably due to the lack of powerful
computing.
27!
navy.cs.vsb.cz!
Computers and Nature inspired Algorithms •  In the essay „Intelligent Machines“ (1948) Turing states
„…if the untrained infant’s mind is to become an intelligent one, it
must acquire both discipline and initiative…discipline is certainly not
enough in itself to produce intelligence. That it is required in
addition we call initiative…our task is to discover the nature of this
residue as it occurs in man, and to try and copy it in machines...“.
•  Next statement suggests a connection between artificial intelligence
and the searching procedures
„…further research into intelligence of machinery will be probably very
greatly concerned with “searches”…”
28!
navy.cs.vsb.cz!
Computers and Nature inspired Algorithms •  Further he opined that „search“ will take place in the space of
integers and probably will be based on the genetic or evolutionary
search (!).
•  In essence, he described evolutionary algorithms:
„…there is the genetic or evolutionary search by which a
combination of genes is looked for, the criterion being the survival
value…“.
29!
navy.cs.vsb.cz!
Computers and Nature inspired Algorithms •  Turing described exactly what is the principle of evolutionary
algorithms. In 1950 this idea more elaborated in the article
"Computering Machinery and Intelligence":
„... We can not expect to find a good child-machine at the first
attempt. One must experiment with teaching one dry machine and
see how well it learns. Then it another try and see if it is better or
worse. There is an obvious connection Between this process and
evolution, by the identifications:
–  structure of child machine = hereditary material
–  changes of the child machine = Mutations
–  natural selection = Judgment of the experimenter …“.
30!
navy.cs.vsb.cz!
Computers and Nature inspired Algorithms
The First Simulations •  One of the first real experiments with evolutionary principles to
computers performed in 1953 Barricelli (Princeton), who performed
simulated evolution.
•  It was published in the journal Methodos called „Esempi Numerica di
processi di evoluzione“. The method perfected in 1962 and
performed evolutionary experiment with 500 eight-bit strings that
represent the simple instructions.
31!
navy.cs.vsb.cz!
Computers and Nature inspired Algorithms
The First Simulations •  N. A. Barricelli said:
„... we have created a class of binary strings which are able to
reproduce and to undergo hereditary changes ... the constitution for
an evolutionary process starting according to the principle of
Darwin's theory would appear to be present.
The which strings have the greatest survival in their environment
will survive. The others strings will be eliminated little by little. A
process of adaptation to the conditions environmental, That is, a
process of Darwinian evolution, and will take place ...“.
32!
navy.cs.vsb.cz!
Evolutionary and genetic dynamics,
processes and laws
Darwin
MEndel
Fitness
Gregor Charles Darwin 12 February 1809 – 19 April 1882. Hereditability
Population
dynamic
DNA coding
(Schrodinger,
Watson and Creek)
Hereditability
Gregor Johann Mendel July 20, 1822 – January 6, 1884. Feature
Fitness
Turing
Baricceli
33!
Modern computer
evolucionists:
Holland, Schwefel,
Rechenberg, Fogel,
Baeck, Price, Koza,
O'Neill, Ryan, ...
navy.cs.vsb.cz!
Walkers Robots 34!
navy.cs.vsb.cz!
Past, Present and Future Past Present 35!
Future ? navy.cs.vsb.cz!
Quantum Computation?
•  A quantum computer (also known as a quantum supercomputer) is
a computation device that makes direct use of quantum-mechanical
phenomena, such as superposition and entanglement, to perform
operations on data.
•  Quantum computers are different from digital computers based on
transistors. Whereas digital computers require data to be encoded
into binary digits (bits), each of which is always in one of two
definite states (0 or 1), quantum computation uses qubits (quantum
bits), which can be in superposition of states.
•  As of 2014 quantum computing is still in its infancy but experiments
have been carried out in which quantum computational operations
were executed on a very small number of qubits.
36!
navy.cs.vsb.cz!
Quantum Computation?
Qubits are made up of controlled parZcles and the means of control (e.g. devices that trap parZcles and switch them from one state to another). Photograph of a chip constructed by D-­‐
Wave Systems Inc. designed to operate as a 128-­‐qubit superconducZng adiabaZc quantum opZmizaZon processor, mounted in a sample holder. 37!
navy.cs.vsb.cz!
DNA Computation?
•  DNA computing is a form of computing which uses DNA,
biochemistry and molecular biology, instead of the traditional siliconbased computer technologies.
•  DNA computing is often called like computation in vitro while
classical computation in silico.
•  This field was initially developed by Leonard Adleman of the
University of Southern California, in 1994.
•  Adleman demonstrated a proof-of-concept use of DNA as a form of
computation which solved the seven-point Hamiltonian path
problem.
•  DNA computing is fundamentally similar to parallel computing.
38!
navy.cs.vsb.cz!
Unconventional Computation?
Cellular Automaton
•  A cellular automaton (pl. cellular automata, abbrev. CA) is a discrete
model studied in computability theory, mathematics, physics,
complexity science, theoretical biology and microstructure modeling.
•  A cellular automaton consists of a regular grid of cells, each in one
of a finite number of states, such as on and off (in contrast to a
coupled map lattice).
•  The concept was originally discovered in the 1940s by Stanislaw
Ulam and John von Neumann while they were contemporaries at
Los Alamos National Laboratory. While studied by some throughout
the 1950s and 1960s, it was not until the 1970s and Conway's Game
of Life.
39!
navy.cs.vsb.cz!
Unconventional Computation?
Cellular Automaton
•  In the 1980s, Stephen Wolfram engaged in a systematic study of
one-dimensional cellular automata, or what he calls elementary
cellular automata (New Kind of Science)
•  http://mathworld.wolfram.com/CellularAutomaton.html
CA can have various neighborhood
40!
navy.cs.vsb.cz!
Unconventional Computation?
Cellular Automaton
•  Another interesting links
–  http://www.youtube.com/watch?v=XcuBvj0pw-E
–  http://www.youtube.com/watch?v=C2vgICfQawE
–  http://www.youtube.com/watch?v=KJe9H6qS82I
•  John Conway - The Game of Life and Set Theory
–  http://www.youtube.com/watch?v=cQUAwhhC8cU
41!
navy.cs.vsb.cz!
Unconventional Computation?
Physarum
•  A Physarum machine is a programmable amorphous biological
computer experimentally implemented in the vegetative state of
true slime mould Physarum polycephalum. It comprises of an
amorphous yellowish mass with networks of protoplasmic veins,
programmed by spatial configurations of attracting and repelling
gradients. So in fact, it is natural computational process…
•  In book Physarum Machines by Andrew Adamatzky demonstrates
how to create Physarum machines for computational geometry and
optimization, and general-purpose computation, see
http://uncomp.uwe.ac.uk/adamatzky/,
https://www.youtube.com/watch?v=whWT1CQLUc8 ,
https://www.youtube.com/user/PhysarumMachines and
http://www.phychip.eu/
42!
navy.cs.vsb.cz!
Unconventional Computation?
Deterministic Chaos
•  Computation with deterministic chaos discuss the mutual
intersection of two interesting fields of research, i.e. deterministic
chaos and evolutionary computation.
•  Evolutionary computation which are able to handle tasks such as
–  Control of various chaotic systems
–  Synthesis of their structure are explored
–  Deterministic chaos can be investigated as a behavioral part of
evolutionary algorithms.
–  Used for special kind of calculations
43!
navy.cs.vsb.cz!
Unconventional Computation?
Fractals
•  A fractal is a mathematical set that typically displays self-similar or
self-affine patterns.
•  It is a product of recursive algorithms..
•  The most common are IFS (Iterated Function System) and TEA
(Time Escape Algorithm).
•  Graphically visualized fractals are very complex structures that can
be used to model natural as well as technical systems and its
behavior.
•  Also kind of calculus was developed for fractals, see book Integral,
Probability, and Fractal Measures by Gerald A. Edgar.
44!
navy.cs.vsb.cz!
Want to know more? •  (Coveney, Highfield, 2003), which deals with the self-organization ,
and is therefore given phenomena between determinism and chaos.
In this publication you can find a lot of interesting information on
evolutionary algorithms, neural networks, phenomena "on the edge
" chaos etc.
•  If the reader is looking for information about A.M. Turing, then you
cannot miss the book (Leavitt, 2007), which is essentially a
biography of the mathematician, whose inventiveness in the
development of computers affected the course of the Second World
War.
45!
navy.cs.vsb.cz!
Want to Know More? •  Also a very good monograph (Lem, 1999) contains information on
artificial intelligence, the author's vision and beliefs. The book is
mainly accounted author's vision, which is not surprising,
considering that the author is dedicated to the so-called futurology.
•  The last book we would like to recommend is (Amos, 2008). This
publication does not deal with history, but rather with the future of
computing technology, based on the so-called DNA computing .
46!
navy.cs.vsb.cz!
Conclusions
• 
• 
• 
• 
Overview of computing machines
Sketch of future computational technologies
Computers and nature inspired algorithms
Unconventional computation
47!
navy.cs.vsb.cz!
THANK YOU FOR YOUR ATTENTION
[email protected]
www.ivanzelinka.eu
48!
navy.cs.vsb.cz!
Copyright
This didactic material is meant for the personal use of the student only,
and is copyrighted. Its reproduction, even for a partial utilization, is
strictly forbidden in compliance with and in force of the law on Authors
rights.
Copyright©NAVY.CS.VSB.CZ
49!
navy.cs.vsb.cz!