Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
NAVY Research Group Department of Computer Science Faculty of Electrical Engineering and Computer Science VŠB-‐TUO 17. listopadu 15 708 33 Ostrava-‐Poruba Czech Republic! Basics of Modern Computer Science Evolutionary Algorithms History of Computers, Programming and its Future Ivan Zelinka MBCS CIPT, www.bcs.org/ http://www.springer.com/series/10624 Department of Computer Science Faculty of Electrical Engineering and Computer Science, VŠB-TUO 17. listopadu 15 , 708 33 Ostrava-Poruba Czech Republic www.ivanzelinka.eu Topics • • • • • • • History of Computer technology from ancient time till today Mechanical computers The first programmable computers Electromechanical computers Computers and nature inspired algorithms Historical facts about true “fathers” of nature inspired algorithms Future computing technologies 2! navy.cs.vsb.cz! Objectives The objectives of the lesson are: • Historical background of computational technologies and its development. • Computers and nature inspired algorithms. – To show that John Holland was not the first researcher who come with the idea of genetic algorithms. – That “father” of genetic algorithms is British mathematician A.M. Turing. – That 20 years before J. Holland the first numerical simulations of evolution were done – genetic algorithms on computers. • Sketch future computational technologies and methods. 3! navy.cs.vsb.cz! Antiquity 4! navy.cs.vsb.cz! Historical facts... • Machine of Antikythera Heron of Alexandria (theater, machines, steam engine ...) Rome and his machine… • Banu Musov (9th century. Baghdad, Kitab al Hijál - Book on sophisticated equipment or by mechanical devices), the supply of hot and cold water, floating excavator to collect diamonds, oil lamp wick automatic leveling… • Self-propelled mechanisms primitive robotics of Leonardo da Vinci, Charles Baggage and Ada Byron… 5! navy.cs.vsb.cz! An8kythera Machine • Machine of Antikythera (ancient ship 100 BC), 1900. • V. Statis, dr. Solla Price 1954), 40 rounds, astrolabe complex, complicated, even though the format handheld device with many clever transfers, which has been able to determine, inter alia, the mere manipulation of dials all year round sunsets and bright stars, the Sun, the Moon and the known planets. • Gemini astronomer, around 77 BC on the island of Rhodes. • Primitive calculator machine was constructed in 1652 by Blaise Pascal. • It was followed by other inventors, but perfection comparable with the astrolabe reached to F. Hahn in 1770. 6! navy.cs.vsb.cz! Another Mechanism • • • • • • Archimedes odometer. Stesibius clocks. Water automat (Heron of Alexandria). Automatic doors (Heron of Alexandria). Automatic theatre (Heron of Alexandria). Heron steam ball - antique steam engine 2,000 years ago? 7! navy.cs.vsb.cz! Middle Ages 8! navy.cs.vsb.cz! The Alchemy and Robots • Human effort to build machines that have a certain level of intelligence is basically as old as our civilization. • In earlier times, was used word „slave“ not a „machine“; compare „computers“ at the beginning of 20th century. • These beings could be included under the name of „homunkulus“ in which production, there are many different recipes. 9! navy.cs.vsb.cz! The First Mechanical Calculator? • Blaise Pascal is one of the inventors of the mechanical calculator in the early 17th Century. Pascal made his invention in 1642. • First called the Arithmetic Machine, Pascal's Calculator and later Pascaline. • Pascal went through 50 prototypes before presenting his first machine to the public in 1645. 10! navy.cs.vsb.cz! Renaissance and Victorian Era 11! navy.cs.vsb.cz! Program-‐Controlled Machine • The Jacquard loom is a mechanical loom, invented by Joseph Marie Jacquard, firstly demonstrated in 1801. • It was programmable machine by special cards to process of manufacturing textiles with complex patterns such as brocade, damask and another textile. 12! navy.cs.vsb.cz! Computer Powered by Steam Difference Engine • Charles Babagge, 26.12.1791 - 18.10.1871. • Difference engine is an automatic mechanical calculator designed to tabulate polynomial functions. • Consists of 8,000 parts, weighs five tons, and measures 11 feet long. • See http://www.computerhistory.org/babbage/ . 13! navy.cs.vsb.cz! Computer Powered by Steam Analytical Engine • Charles Babagge, 26.12.1791 - 18.10.1871. • Analytical engine - a general-purpose programmable computing engine. • The logical structure of the Analytical Engine was essentially the same as the one which has dominated computer design in the electronic era - the separation of the memory (the 'Store') from the central processor (the 'Mill'), serial operation using a 'fetchexecute cycle', and facilities for inputting and outputting data and instructions. • Calling Babbage „the first computer pioneer“ is not a casual tribute. 14! navy.cs.vsb.cz! Augusta Ada King • She is mainly known for having written a description of Charles Babbage's early mechanical general-purpose computer, the Analytical Engine. • Today she is appreciated as the "first programmer" since she was writing programs - that is, encoding an algorithm in a form to be processed by a machine - for a machine that Babbage had not yet built. • She also foresaw the capability of computers to go beyond mere calculating or number-crunching while others, including Babbage himself, focused only on these capabilities. 15! navy.cs.vsb.cz! 20th century 16! navy.cs.vsb.cz! Zuse Z3 • The Z3 was an electromechanical computer designed by Konrad Zuse. • It was the world's first working programmable, fully automatic digital computer. • The Z3 was built with 2000 relays, implementing a 22-bit words that operated at a clock frequency of about 5–10 Hz. Program code and data were stored on punched film. • The Z3 was completed in Berlin in 1941. • Thanks to this machine and its predecessors, Konrad Zuse is often regarded as the inventor of the computer. 17! navy.cs.vsb.cz! Zuse Z3 Zuse Z3 replica on display at Deutsches Museum in Munich 18! navy.cs.vsb.cz! The Colossus Computer • The Colossus was the world's first electronic digital computer that was fully programmable. • The Colossus computers were developed for British codebreakers during World War II to help in the cryptanalysis of the Lorenz cipher. • Designed by the engineer Tommy Flowers to solve a problem posed by mathematician Max Newman at the Government Code and Cypher School (GC&CS) at Bletchley Park. • The prototype, Colossus Mark 1, was shown to be working in December 1943 and was operational at Bletchley Park by 5 February 1944. • Ten Colossi were in use by the end of the war. 19! navy.cs.vsb.cz! The Bombe Computer • Turing's machine that helped decode Enigma was the electromechanical Bombe, not Colossus. • The bombe was an electromechanical device used by British cryptologists to help decipher German Enigma-machine-encrypted secret messages during World War II. • It was a substantial development from a device that had been designed in 1938 by Polish Cipher Bureau cryptologist Marian Rejewski. • The bombe was designed to discover some of the daily settings of the Enigma machines. 20! navy.cs.vsb.cz! The Colossus and Bombe The Bombe computer. The Colossus computer. 21! navy.cs.vsb.cz! Altair Computer • MITS Altair 8800 is a microcomputer designed in 1975 based on the Intel 8080 CPU. • The Altair is widely recognized as the spark that ignited the microcomputer revolution. • It was expected to sell a few hundred build-it-yourself kits to hobbyists, and surprised producer when they sold thousands in the first month. • The computer bus designed for the Altair was to become a de facto standard in the form of the S-100 bus, and the first programming language for the machine was Microsoft's founding product, Altair BASIC. 22! navy.cs.vsb.cz! Altair Computer 23! navy.cs.vsb.cz! Modern Computers • Nowadays there are many computer centers, working on the basis of coupled parallel computers. In this consequences we also speak about the so-called "grid computing„ , „cloud computing“ or "high performance computing" (HPC). • As an example, an older set of one thousand PC with a Pentium II processor running at 350 MHz and 64 Mbyte RAM OS running on Red Hat Linux 6.0. • It is a configuration of Beowulf (see also http://www.beowulf.org/overview/index.html. • Overview about modern HPC can be found at http://www.top500.org/. • IT4 Innovations, VSB-TU Ostrava http://www.it4i.cz/?lang=en . • PRACE http://www.prace-ri.eu/?lang=en . 24! navy.cs.vsb.cz! Modern Computers • PRACE in a few words. • PRACE (Partnership for Advanced Computing in Europe) is to enable high impact scientific discovery and engineering research and development. 25! navy.cs.vsb.cz! Modern Computers 26! navy.cs.vsb.cz! Computers and Nature inspired Algorithms • Top of the history of evolutionary algorithms usually dates back to the mid-70s (Holland, 1975), when genetic algorithms were introduced, possibly in the mid 60s when they were successfully used in the evolutionary strategies (Rechenberg, 1973) (Schwefel , 1977). • However, taking all the facts into account, it is safe to say that the spiritual father of evolutionary computation techniques are such personalities as mathematician A.M. Turing, N.A. Barricelli and others. • Already at that time principles, which clearly describe the principles of modern algorithms, were formulated and defined. It was not programmatically realized, probably due to the lack of powerful computing. 27! navy.cs.vsb.cz! Computers and Nature inspired Algorithms • In the essay „Intelligent Machines“ (1948) Turing states „…if the untrained infant’s mind is to become an intelligent one, it must acquire both discipline and initiative…discipline is certainly not enough in itself to produce intelligence. That it is required in addition we call initiative…our task is to discover the nature of this residue as it occurs in man, and to try and copy it in machines...“. • Next statement suggests a connection between artificial intelligence and the searching procedures „…further research into intelligence of machinery will be probably very greatly concerned with “searches”…” 28! navy.cs.vsb.cz! Computers and Nature inspired Algorithms • Further he opined that „search“ will take place in the space of integers and probably will be based on the genetic or evolutionary search (!). • In essence, he described evolutionary algorithms: „…there is the genetic or evolutionary search by which a combination of genes is looked for, the criterion being the survival value…“. 29! navy.cs.vsb.cz! Computers and Nature inspired Algorithms • Turing described exactly what is the principle of evolutionary algorithms. In 1950 this idea more elaborated in the article "Computering Machinery and Intelligence": „... We can not expect to find a good child-machine at the first attempt. One must experiment with teaching one dry machine and see how well it learns. Then it another try and see if it is better or worse. There is an obvious connection Between this process and evolution, by the identifications: – structure of child machine = hereditary material – changes of the child machine = Mutations – natural selection = Judgment of the experimenter …“. 30! navy.cs.vsb.cz! Computers and Nature inspired Algorithms The First Simulations • One of the first real experiments with evolutionary principles to computers performed in 1953 Barricelli (Princeton), who performed simulated evolution. • It was published in the journal Methodos called „Esempi Numerica di processi di evoluzione“. The method perfected in 1962 and performed evolutionary experiment with 500 eight-bit strings that represent the simple instructions. 31! navy.cs.vsb.cz! Computers and Nature inspired Algorithms The First Simulations • N. A. Barricelli said: „... we have created a class of binary strings which are able to reproduce and to undergo hereditary changes ... the constitution for an evolutionary process starting according to the principle of Darwin's theory would appear to be present. The which strings have the greatest survival in their environment will survive. The others strings will be eliminated little by little. A process of adaptation to the conditions environmental, That is, a process of Darwinian evolution, and will take place ...“. 32! navy.cs.vsb.cz! Evolutionary and genetic dynamics, processes and laws Darwin MEndel Fitness Gregor Charles Darwin 12 February 1809 – 19 April 1882. Hereditability Population dynamic DNA coding (Schrodinger, Watson and Creek) Hereditability Gregor Johann Mendel July 20, 1822 – January 6, 1884. Feature Fitness Turing Baricceli 33! Modern computer evolucionists: Holland, Schwefel, Rechenberg, Fogel, Baeck, Price, Koza, O'Neill, Ryan, ... navy.cs.vsb.cz! Walkers Robots 34! navy.cs.vsb.cz! Past, Present and Future Past Present 35! Future ? navy.cs.vsb.cz! Quantum Computation? • A quantum computer (also known as a quantum supercomputer) is a computation device that makes direct use of quantum-mechanical phenomena, such as superposition and entanglement, to perform operations on data. • Quantum computers are different from digital computers based on transistors. Whereas digital computers require data to be encoded into binary digits (bits), each of which is always in one of two definite states (0 or 1), quantum computation uses qubits (quantum bits), which can be in superposition of states. • As of 2014 quantum computing is still in its infancy but experiments have been carried out in which quantum computational operations were executed on a very small number of qubits. 36! navy.cs.vsb.cz! Quantum Computation? Qubits are made up of controlled parZcles and the means of control (e.g. devices that trap parZcles and switch them from one state to another). Photograph of a chip constructed by D-‐ Wave Systems Inc. designed to operate as a 128-‐qubit superconducZng adiabaZc quantum opZmizaZon processor, mounted in a sample holder. 37! navy.cs.vsb.cz! DNA Computation? • DNA computing is a form of computing which uses DNA, biochemistry and molecular biology, instead of the traditional siliconbased computer technologies. • DNA computing is often called like computation in vitro while classical computation in silico. • This field was initially developed by Leonard Adleman of the University of Southern California, in 1994. • Adleman demonstrated a proof-of-concept use of DNA as a form of computation which solved the seven-point Hamiltonian path problem. • DNA computing is fundamentally similar to parallel computing. 38! navy.cs.vsb.cz! Unconventional Computation? Cellular Automaton • A cellular automaton (pl. cellular automata, abbrev. CA) is a discrete model studied in computability theory, mathematics, physics, complexity science, theoretical biology and microstructure modeling. • A cellular automaton consists of a regular grid of cells, each in one of a finite number of states, such as on and off (in contrast to a coupled map lattice). • The concept was originally discovered in the 1940s by Stanislaw Ulam and John von Neumann while they were contemporaries at Los Alamos National Laboratory. While studied by some throughout the 1950s and 1960s, it was not until the 1970s and Conway's Game of Life. 39! navy.cs.vsb.cz! Unconventional Computation? Cellular Automaton • In the 1980s, Stephen Wolfram engaged in a systematic study of one-dimensional cellular automata, or what he calls elementary cellular automata (New Kind of Science) • http://mathworld.wolfram.com/CellularAutomaton.html CA can have various neighborhood 40! navy.cs.vsb.cz! Unconventional Computation? Cellular Automaton • Another interesting links – http://www.youtube.com/watch?v=XcuBvj0pw-E – http://www.youtube.com/watch?v=C2vgICfQawE – http://www.youtube.com/watch?v=KJe9H6qS82I • John Conway - The Game of Life and Set Theory – http://www.youtube.com/watch?v=cQUAwhhC8cU 41! navy.cs.vsb.cz! Unconventional Computation? Physarum • A Physarum machine is a programmable amorphous biological computer experimentally implemented in the vegetative state of true slime mould Physarum polycephalum. It comprises of an amorphous yellowish mass with networks of protoplasmic veins, programmed by spatial configurations of attracting and repelling gradients. So in fact, it is natural computational process… • In book Physarum Machines by Andrew Adamatzky demonstrates how to create Physarum machines for computational geometry and optimization, and general-purpose computation, see http://uncomp.uwe.ac.uk/adamatzky/, https://www.youtube.com/watch?v=whWT1CQLUc8 , https://www.youtube.com/user/PhysarumMachines and http://www.phychip.eu/ 42! navy.cs.vsb.cz! Unconventional Computation? Deterministic Chaos • Computation with deterministic chaos discuss the mutual intersection of two interesting fields of research, i.e. deterministic chaos and evolutionary computation. • Evolutionary computation which are able to handle tasks such as – Control of various chaotic systems – Synthesis of their structure are explored – Deterministic chaos can be investigated as a behavioral part of evolutionary algorithms. – Used for special kind of calculations 43! navy.cs.vsb.cz! Unconventional Computation? Fractals • A fractal is a mathematical set that typically displays self-similar or self-affine patterns. • It is a product of recursive algorithms.. • The most common are IFS (Iterated Function System) and TEA (Time Escape Algorithm). • Graphically visualized fractals are very complex structures that can be used to model natural as well as technical systems and its behavior. • Also kind of calculus was developed for fractals, see book Integral, Probability, and Fractal Measures by Gerald A. Edgar. 44! navy.cs.vsb.cz! Want to know more? • (Coveney, Highfield, 2003), which deals with the self-organization , and is therefore given phenomena between determinism and chaos. In this publication you can find a lot of interesting information on evolutionary algorithms, neural networks, phenomena "on the edge " chaos etc. • If the reader is looking for information about A.M. Turing, then you cannot miss the book (Leavitt, 2007), which is essentially a biography of the mathematician, whose inventiveness in the development of computers affected the course of the Second World War. 45! navy.cs.vsb.cz! Want to Know More? • Also a very good monograph (Lem, 1999) contains information on artificial intelligence, the author's vision and beliefs. The book is mainly accounted author's vision, which is not surprising, considering that the author is dedicated to the so-called futurology. • The last book we would like to recommend is (Amos, 2008). This publication does not deal with history, but rather with the future of computing technology, based on the so-called DNA computing . 46! navy.cs.vsb.cz! Conclusions • • • • Overview of computing machines Sketch of future computational technologies Computers and nature inspired algorithms Unconventional computation 47! navy.cs.vsb.cz! THANK YOU FOR YOUR ATTENTION [email protected] www.ivanzelinka.eu 48! navy.cs.vsb.cz! Copyright This didactic material is meant for the personal use of the student only, and is copyrighted. Its reproduction, even for a partial utilization, is strictly forbidden in compliance with and in force of the law on Authors rights. Copyright©NAVY.CS.VSB.CZ 49! navy.cs.vsb.cz!