AI21 Labs’ “Human or Not?” experiment has become a viral sensation, with over 10 million conversations conducted by people worldwide on the Turing test-style social game. Participants are asked to talk for two minutes with either a fellow participant or an AI bot based on leading language models before guessing whether they were chatting with a human or a machine. After analyzing the first two million conversations and guesses, the team found the following from participants: 68% guessed correctly, with France at 71.3% and India at 63.5%; personal questions were frequently asked of AI bots as people believed they wouldn’t know; and politeness was considered less human.
https://www.ai21.com/blog/human-or-not-results