• Email Us: [email protected]
  • Contact Us: +1 718 874 1545
  • Skip to main content
  • Skip to primary sidebar

Medical Market Report

  • Home
  • All Reports
  • About Us
  • Contact Us

Controversial Experiment Saw Mental Health Support Provided Using AI

January 9, 2023 by Deborah Bloomfield

An experiment that saw mental health support provided to about 4,000 humans using an artificial intelligence (AI) chatbot has been met with severe criticism online, over concerns about informed consent.

On Friday, Rob Morris, co-founder of the social media app Koko, announced the results of an experiment his company had run using GPT-3.  

Advertisement

Koko allows people to volunteer their problems to other users, who then try to help them “rethink”  the situation, in what has been likened to a form of cognitive behavioral therapy. For the experiment, Koko users could opt to have an AI helper compose responses to human users, which they could then use (or modify or replace if necessary). 

“Messages composed by AI (and supervised by humans) were rated significantly higher than those written by humans on their own (p < .001). Response times went down 50%, to well under a minute," Morris wrote on Twitter.

“And yet… we pulled this from our platform pretty quickly. Why?” he added. “Once people learned the messages were co-created by a machine, it didn’t work. Simulated empathy feels weird, empty.”

Advertisement

While he went on to suggest that this could be because language models – essentially really, really good autocomplete – do not have human lived experience and so their responses come across as inauthentic, a lot of people focused on whether the participants had provided informed consent.

In a later clarification, Morris stressed that they “were not pairing people up to chat with GPT-3, without their knowledge”.

People have pointed out that it is not clear how the statement “everyone knew about the feature” fits with the claim “once people learned the messages were co-written by a machine, it didn’t work”. 

Morris told Insider that the study was “exempt” from informed consent law, pointing to a previous study by the company which had also been exempt, and that “every individual has to provide consent to use the service”.

“This imposed no further risk to users, no deception, and we don’t collect any personally identifiable information or personal health information (no email, phone number, ip, username, etc),” he added.

A better look at the methodology would help to clarify when informed consent was given and when the participants learned that responses could have been created by (human-supervised) AI. However, it is unclear at this stage whether the data will be published, with Morris now describing it to Insider as not a university study, “just a product feature explored”.

Deborah Bloomfield
Deborah Bloomfield

Related posts:

  1. U.N. rights chief regrets lack of access to Xinjiang
  2. New Age Meats bites into $25M for cultured meat product line development
  3. Conagra flags price increases to cushion inflation impact, raises sales forecast
  4. A Video From 1938 Has People Convinced Of Time Travel. But What The Hell Is Really Going On?

Source Link: Controversial Experiment Saw Mental Health Support Provided Using AI

Filed Under: News

Primary Sidebar

  • What Are Those Zigzags You See In Spiders’ Webs? Study Finds They Could Be A Kind Of Alarm System
  • The Deepest Fish Ever Filmed Was Found 8,336 Meters Below The Surface In A Vast Ocean Trench
  • Supersonic Flight Without The Boom: NASA’s X-59 Experimental Aircraft Takes Flight For First Time
  • The Oldest Ice Ever Recovered Contains Antarctic Air Bubbles From 6 Million Years Ago
  • Freaky “Frankenstein” Worms Can Get Reproduction Wrong And End Up With Two Heads
  • Hedgehog, Lasagna, and Brussels Sprouts: Meet 2025’s Newly Named North Atlantic Right Whales
  • Can You Be Allergic To Other People? Yes, And It Sounds Like The Worst Thing Ever
  • Animals With “Urban Superpowers” Lurk In London’s Underground, And Some Of Them Want To Drink Your Blood
  • This Is The Largest Radio Color Image Of The Milky Way Ever Assembled – And It’s Gorgeous
  • Why We Can’t Stop Watching True Crime: The Psychological Pull And The Ethical Push
  • “Silent, Ongoing Genocide”: World’s 196 Uncontacted Tribes Are Facing Grave Threats To Their Survival
  • Golden Tigers Are Among The Rarest Big Cats In The World, But They Spell Bad News For Tigers
  • Rare 2-Million-Year-Old Infant Facial Fossils Expand What We Know About Prehistoric Human Children
  • First-Ever 3D Map Of Planet Outside Solar System Reveals Distant World’s Hot Spot And Cool Ring
  • From Chains To Forests: Working Elephants Set To Be Rehabilitated In The Wild Under New Project
  • Why Does Death Have Such A Distinctive Smell?
  • Blue Dogs Have Been Spotted In Chernobyl: What Is Going On?
  • Record-Breaking Gravitational Wave Detection Suggests These Black Holes Merged Before
  • Hurricane Melissa Is 2025’s Strongest Storm Yet, With Turbulence So Bad It Saw Off The Hurricane Hunters
  • Fancy Seeing Your Organs In 4D? Pretty Soon, You Might Be Able To
  • Business
  • Health
  • News
  • Science
  • Technology
  • +1 718 874 1545
  • +91 78878 22626
  • [email protected]
Office Address
Prudour Pvt. Ltd. 420 Lexington Avenue Suite 300 New York City, NY 10170.

Powered by Prudour Network

Copyrights © 2025 · Medical Market Report. All Rights Reserved.

Go to mobile version