Winograd schema challenge
The Winograd schema challenge (WSC) is a test of machine intelligence proposed in 2012 by Hector Levesque, a computer scientist at the University of Toronto. Designed to be an improvement on the Turing test, it is a multiple-choice test that employs Winograd schemas, questions of a very specific structure named after Terry Winograd, a professor of computer science at Stanford University.
On the surface, Winograd schema questions simply require the resolution of anaphora: the machine must identify the antecedent of an ambiguous pronoun in a statement. This makes it a task of natural language processing, but Levesque argues that for Winograd schemas, the task requires the use of knowledge and commonsense reasoning.
The challenge is considered "defeated" since 2019, when a number of transformer-based language models achieved accuracies of over 90%.