Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download Concerning the adequacy of the Turing test
Document related concepts
Transcript
Paweł Łupkowski Section of Logic and Cognitive Science Institute of Psychology Adam Mickiewicz University [email protected] Concerning the adequacy of the Turing test Dyskusje wokół zagadnienia adekwatności testu Turinga Opole 2006 It should be replaced by a different test It is to hard The Turing test It is to easy A B C the Turing test B C the Turing test – viva voce “The idea of the test is that the machine has to pretend to be a man, by answering questions put to it, and will only pass if the pretence is reasonably convincing [...] We had better suppose that each jury has to judge quite a number times, and that sometimes they really are dealing with a man not a machine. That will prevent them saying: «It must be a machine» every time without proper consideration.” (Turing 1952, p. 5) the Turing test “The TT Claim” Imitation game provides a good test for the presence of intelligence “The Thinking Machine Claim” Appropriately programmed computer could pass the kind of test, that is described by `The TT Claim' (French 1990) TT is to hard Turing Test (A.M. Turing) TT is to hard Loebner Prize Competition (H. Loebner) Restricted TT Turing Test (A.M. Turing) Loebner Prize Competition (Restricted TT) • Limiting the topic • Limiting the tenor Loebner Prize Competition (Restricted TT) Topics during the Loebner Prize Competition • Bad Marriage • Burgundy Wine • Cats versus Dogs • Classic Star Trek • Pets • Small Talk • Shakespeare's Plays • (...) Loebner Prize Competition (Restricted TT) 2006 EDITION • 'Hello, my name is John and I am a man.' • 'Hello, my name is Joan, and I am a woman.' http://loebner.net/Prizef/2006_Contest/2006_Rules.txt Kremer Prize • The goals of the Kremer prize were clear. • The basic sciences underlying human powered flight were, by 1959, well understood. the Gossamer Condor (Shieber 1994) TT is to hard Loebner Prize Competition (H. Loebner) Restricted TT Turing Test (A.M. Turing) TT is to hard Subcognitive questions and TT (R. French) TT will never be passed Loebner Prize Competition (H. Loebner) Restricted TT Turing Test (A.M. Turing) R. French subcognitive questions lowlevel cognitive structure (French 1990, 2000) R. French: associative priming bread (French 1990, 2000) R. French: associative priming butter (French 1990, 2000) R. French: associative priming dog (French 1990, 2000) R. French: associative priming butter (French 1990, 2000) R. French Rating games On scale of 0 (completely implausible) to 10 (completely plausible), please rate: banana splits as medicine purses as weapons pens as weapons jackets as blankets pine boughs as mattresses (French 1990, 2000) R. French PMIIR algorithm answering subcognitive questions using statistical information extracted from very large collection of texts. (P.D. Turney, http://purl.org/net/peter.turney) TT is to hard Subcognitive questions and TT (R. French) TT will never be passed Loebner Prize Competition (H. Loebner) Turing Test (A.M. Turing) Restricted TT TT is to easy TT is to hard Subcognitive questions and TT (R. French) TT will never be passed Loebner Prize Competition (H. Loebner) TTT Turing Test (A.M. Turing) (S. Harnad) TT+robotic capacities Restricted TT TT is to easy The Total Turing Test Level t1 The ‘toymodel’ level. Level T2 This is the level described in Turing’s original article. Level T3 The ‘Total Turing Test’ (or the robotic Turing Test) Level T4 ‘Microfunctional Indistinguishability’ (Harnad 2000) Level T5 ‘Grand Unified Theories of Everything (GUTE)’ The Total Turing Test Level t1 The ‘toymodel’ level. Level T2 This is the level described in Turing’s original article. Level T3 The ‘Total Turing Test’ (or the robotic Turing Test) Level T4 ‘Microfunctional Indistinguishability’ (Harnad 2000) Level T5 ‘Grand Unified Theories of Everything (GUTE)’ TT is to hard Subcognitive questions and TT (R. French) TT will never be passed Loebner Prize Competition (H. Loebner) TTT Turing Test (A.M. Turing) (S. Harnad) TT+robotic capacities Restricted TT TT is to easy TT is to hard Subcognitive questions and TT (R. French) TT will never be passed TRTTT Loebner Prize Competition (H. Loebner) Restricted TT TTT Turing Test (A.M. Turing) (S. Harnad) TT+robotic capacities (P. Schweizer) long term, evolutionary criterion for cognitive types TT is to easy The Truly Total Turing Test • types / tokens of cognitive systems • historical record of cognitive systems types intelligence • longtime, evolutionary criterion (Schweizer 1998) The Truly Total Turing Test “It is essential to note that the TRTTT is not a test of individual cognitive systems. Instead, it is meant to test the overall capacities of the type of cognitive architecture of which particular individuals are tokens.” (Schweizer 1998, p. 267268) TT is to hard Subcognitive questions and TT (R. French) TT will never be passed Loebner Prize Turing Test (A.M. Turing) TRTTT TTT Competition (S. Harnad) (H. Loebner) TT+robotic capacities Restricted TT (P. Schweizer) long term, evolutionary criterion for cognitive types TT is to easy Inverted TT TT is to hard Subcognitive questions and TT (R. French) TT will never be passed Loebner Prize Turing Test (A.M. Turing) TRTTT TTT Competition (S. Harnad) (H. Loebner) TT+robotic capacities Restricted TT (P. Schweizer) long term, evolutionary criterion for cognitive types TT is to easy Inverted Turing test Instead of evaluating a congruence between the linguistic behavior of a system and a person, it evaluates a congruence between system's and person's ascription of mental states. (Watt 1996) Inverted Turing test HEY BERT, ASK IF IT HAS A FAVOURITE COLOUR Inverted TT TT is to hard Subcognitive questions and TT (R. French) TT will never be passed Loebner Prize Turing Test (A.M. Turing) TRTTT TTT Competition (S. Harnad) (H. Loebner) TT+robotic capacities Restricted TT (P. Schweizer) long term, evolutionary criterion for cognitive types TT is to easy Inverted TT Lovelace Test TT is to hard Subcognitive questions and TT (R. French) TT will never be passed Loebner Prize Turing Test (A.M. Turing) TRTTT TTT Competition (S. Harnad) (H. Loebner) TT+robotic capacities Restricted TT (P. Schweizer) long term, evolutionary criterion for cognitive types TT is to easy Lovelace Test The test is passed when: i) The artificial agent A produces output O ii) A's output O is not the result of hardware error, but the result of processes that A can repeat iii) H – or someone who knows what H knows and who has H's resources – cannot explain how A produced O by appeal to A's architecture, knowledgebase and core functions (Bringsjord 2001) Inverted TT Lovelace Test TT is to hard Subcognitive questions and TT (R. French) TT will never be passed Loebner Prize Turing Test (A.M. Turing) TRTTT TTT Competition (S. Harnad) (H. Loebner) TT+robotic capacities Restricted TT (P. Schweizer) long term, evolutionary criterion for cognitive types TT is to easy (...) there are real world problems that are revealed by considering the strengths and weaknesses of the Turing test. (D. Dennett, 1985) Paweł Łupkowski Section of Logic and Cognitive Science Institute of Psychology Adam Mickiewicz University [email protected] www.kognitywistyka.amu.edu.pl
