May 25, 2022

Turing Test is unreliable. The Winograd Schema is obsolete. Coffee is the answer

Posted by in category: computing

Marcus said the Turing test is not a reliable measure of intelligence because humans are susceptible, and machines can be evasive. Philosopher John Searle introduced the Chinese Room Argument that asserts programming a digital computer may make it appear to understand the language but could not produce real understanding. Even if a computer can interpret symbols and provide sensical responses, it can’t be said to be truly “conscious” because it doesn’t really understand what the symbols mean.

Hector Levesque, a computer scientist at the University of Toronto, proposed the Winograd schema challenge in 2011. Ernest Davis, Leora Morgenstern, Charles Ortiz, and Gary Marcus developed the schema further. Hector designed it as an improvement of the Turing test. The test is structured with multiple-choice questions called Winograd schemas.

Winograd schemas were named after Terry Winograd, professor of computer science at Stanford University. It is a pair of sentences whose intended meaning can be flipped by changing just one word. They generally involve unclear pronouns or possessives.

Comments are closed.