• Email Us: [email protected]
  • Contact Us: +1 718 874 1545
  • Skip to main content
  • Skip to primary sidebar

Medical Market Report

  • Home
  • All Reports
  • About Us
  • Contact Us

“Human Or Not”: Millions Of People Just Participated In An Online Turing Test

August 23, 2023 by Deborah Bloomfield

Artificial intelligence (AI) has already passed a hefty test, proving they are better than humans at passing those online “I am not a robot” CAPTCHA tests. But can they pass the Turing test? 

The Turing test (which renowned mathematician and computer scientist Alan Turing originally and much more modestly called The Imitation Game) involves separating a human participant from a conversation partner and asking them to determine if they are human or AI. In the original version, a human evaluator sees the text conversation between one human and one AI, and must determine which is which.

Advertisement

In later modifications to the thought experiment, experimenters have put chatbots to the test directly, having the evaluator talk to the AI themselves. In one such recent experiment – conducted following an explosion of large language model (LLM) chatbots such as Chat GPT and Google Bard – over a million humans got to take part.

The team, in a preprint paper that has yet to be peer-reviewed, detailed how they created a game of roulette. Volunteers could go play an online game called Human or Not, in which their only task was to determine if they were talking to an AI or a fellow human. The game would either assign them a fellow player or an AI.

The team created backstories for the bots, which were created using several different chat AIs.

“We created a diverse array of bots, each with its unique personality and objective,” the team wrote in their study. “We were motivated by the desire to keep the conversations interesting and less repetitive for recurring users, and to obscure the tell-tale signs of bots, making detection more challenging.”

Advertisement

One such character bio included in the paper – Adam – is told to try to convince the other users that he is them from the future. While it may not sound like the sort of thing humans would do, it might be the sort of thing a human pretending to be an AI would do, adding to the game’s difficulty and fun.

In the first month, they got over 10 million guesses from 1.5 million unique users, making it a decent dataset to analyze. 

“From the vast pool of interactions, we identified several types of human players that excelled in different aspects of the game: players who were proficient at recognizing fellow humans, players who convincingly signaled their own humanity, and players who masterfully impersonated bots.”

Humans in the experiment paid a lot of attention to typos and slang, believing that they generally wouldn’t come from a machine, but many of these were also simulated by the AI chatbots. When humans tried to convince their partners that they were human, they would often use more slang and more typos, as well as answering personal and emotional questions.

Advertisement

“A more distinctive approach involved using foul language, expressing controversial views, and posing messages that AI bots tend to avoid answering,” they wrote, adding “the use of rude language revealed a player’s humanity 86.7 percent of the time”.

Overall, humans guessed the identity of their partners correctly in only 68 percent of the games. When their opponent was a chatbot, they guessed correctly 60 percent of the time, whilst 73 percent of the time they were able to correctly identify they were talking to a human companion.

The team acknowledges the test has its limitations, including that the nature of the game likely raised the participants’ suspicions and affected their strategies in conversations, but said that it provided insight into strategies humans use to identify whether we are talking to a fellow human or a machine.

The paper is available on the pre-print server arXiv.

Deborah Bloomfield
Deborah Bloomfield

Related posts:

  1. Cricket-NZ players reach Dubai after ‘specific, credible threat’ derailed Pakistan tour
  2. Ireland thinks Britain unlikely to trigger N.Ireland trade clause
  3. 800-Kilogram Ostrich-Like Dinosaurs Stomped Around Mississippi 85 Million Years Ago
  4. Capuchin Mother Cares For Disabled Baby In Life And Death

Source Link: "Human Or Not": Millions Of People Just Participated In An Online Turing Test

Filed Under: News

Primary Sidebar

  • DNA From Greenland Sled Dogs – Maybe The World’s Oldest Breed – Reveals 1,000 Years Of Arctic History
  • Why Doesn’t Moonrise Shift By The Same Amount Each Night?
  • Moa De-Extinction, Fashionable Chimps, And Robot Surgery – No Human Required
  • “Human”: Powerful New Images Mark The Most Scientifically Accurate “Hyper-Real 3D Models Of Human Species Ever”
  • Did We Accidentally Leave Life On The Moon In 2019 – And Could We Revive It?
  • 1.8 Million Years Ago, Two Extinct Humans Had One Of The Gnarliest Deaths In History
  • “Powerful Image” Of One Of The World’s Rarest Tigers Exposes The Real Danger In Taman Negara
  • Evolution, Domestication, And A Lot Of Very Good Boys: How Wolves Became Dogs
  • Why Do Orcas Have White Spots Near Their Eyes?
  • Tomb Of First King Of Ancient Maya City Discovered In Belize
  • The Real Reason The Tip Of Your Tape Measure Wiggles Like That
  • The “Haunting” Last Message From NASA’s Opportunity Rover, Sent From Inside A Planet-Wide Storm
  • Adorable Video Proves Not All Gorillas Hate The Rain. It Might Even Win One A Mate
  • 5,000-Year-Old Rock Art May Show One Of Ancient Egypt’s First Rulers
  • Alzheimer’s-Linked Protein Levels “20 Times Higher” In Newborn Babies – What Does This Mean?
  • Americans Were Asked If They Thought Civil War Was Coming. The Results Were Unexpected
  • Voyager 1 & 2 Could Be Detected From Almost A Light-Year Away With Our Current Technology
  • Dams Have Nudged Earth’s Poles By Over 1 Meter In The Past 200 Years
  • This Sugar Could Be A Cure For Male Pattern Baldness – And It’s Been In Our Bodies All Along
  • “Cosmic Immigrants”: Daytime Star Seen In 1604 May Be An “Alien Type Ia Supernova”
  • Business
  • Health
  • News
  • Science
  • Technology
  • +1 718 874 1545
  • +91 78878 22626
  • [email protected]
Office Address
Prudour Pvt. Ltd. 420 Lexington Avenue Suite 300 New York City, NY 10170.

Powered by Prudour Network

Copyrights © 2025 · Medical Market Report. All Rights Reserved.

Go to mobile version