• Email Us: [email protected]
  • Contact Us: +1 718 874 1545
  • Skip to main content
  • Skip to primary sidebar

Medical Market Report

  • Home
  • All Reports
  • About Us
  • Contact Us

Everyone’s Having A Field Day With ChatGPT – But Nobody Knows How It Actually Works

December 16, 2022 by Deborah Bloomfield

The Conversation

ChatGPT is the latest and most impressive artificially intelligent chatbot yet. It was released two weeks ago, and in just five days hit a million users. It’s being used so much that its servers have reached capacity several times.

OpenAI, the company that developed it, is already being discussed as a potential Google slayer. Why look up something on a search engine when ChatGPT can write a whole paragraph explaining the answer? (There’s even a Chrome extension that lets you do both, side by side.)

Advertisement

But what if we never know the secret sauce behind ChatGPT’s capabilities?

The chatbot takes advantage of a number of technical advances published in open scientific literature in the past couple of decades. But any innovations unique to it are secret. OpenAI could well be trying to build a technical and business moat to keep others out.

The ChatPGT site has gone down multiple times due to an influx of users. OpenAI/Screenshot

What it can (and can’t do)

ChatGPT is very capable. Want a haiku on chatbots? Sure.

Advertisement

Chatbots, oh so wise

Endlessly processing

Answers from the void.

Advertisement

How about a joke about chatbots? No problem.

Why did the chatbot cross the road?

To get to the other side – of your screen!

Advertisement

ChatGPT can do many other tricks. It can write computer code to a user’s specification, draft business letters or rental contracts, compose homework essays and even pass university exams.

Just as important is what ChatGPT can’t do. For instance, it struggles to distinguish between truth and falsehood. It is also often a persuasive liar.

What is the fastest marine mammal?

Advertisement

The fastest marine mammal is the sailfish.

The sailfish is not a mammal.

You are correct, the sailfish is not a mammal. I apologize for the mistake. The fastest marine mammal is the peregrine falcon.

Advertisement

ChatGPT is a bit like autocomplete on your phone. Your phone is trained on a dictionary of words so it completes words. ChatGPT is trained on pretty much all of the web, and can therefore complete whole sentences – or even whole paragraphs.

However, it doesn’t understand what it’s saying, just what words are most likely to come next.

Open only by name

In the past, advances in AI have been accompanied by peer-reviewed literature.

Advertisement

In 2018, for example, when the Google Brain team developed the BERT neural network on which most natural language processing systems are now based (and we suspect ChatGPT is too), the methods were published in peer-reviewed scientific papers and the code was open-sourced.

And in 2021, DeepMind’s AlphaFold 2, a protein-folding software, was Science’s Breakthrough of the Year. The software and its results were open-sourced so scientists everywhere could use them to advance biology and medicine.

Following the release of ChatGPT, we have only a short blog post describing how it works. There has been no hint of an accompanying scientific publication, or that the code will be open-sourced.

Advertisement

To understand why ChatGPT could be kept secret, you have to understand a little about the company behind it.

OpenAI is perhaps one of the oddest companies to emerge from Silicon Valley. It was set up as a non-profit in 2015 to promote and develop “friendly” AI in a way that “benefits humanity as a whole”. Elon Musk, Peter Thiel and other leading tech figures pledged US$1 billion towards its goals.

Their thinking was we couldn’t trust for-profit companies to develop increasingly capable AI that aligned with humanity’s prosperity. AI therefore needed to be developed by a non-profit and, as the name suggested, in an open way.

Advertisement

In 2019 OpenAI transitioned into a capped for-profit company (with investors limited to a maximum return of 100 times their investment) and took a US$1 billion investment from Microsoft so it could scale and compete with the tech giants.

It seems money got in the way of OpenAI’s initial plans for openness.

Profiting from users

On top of this, OpenAI appears to be using feedback from users to filter out the fake answers ChatGPT hallucinates.

Advertisement

According to its blog, OpenAI initially used reinforcement learning in ChatGPT to downrank fake and/or problematic answers using a costly hand-constructed training set.

But ChatGPT now seems to be being tuned by its more than a million users. I imagine this sort of human feedback would be prohibitively expensive to acquire in any other way.

We are now facing the prospect of a significant advance in AI using methods that are not described in the scientific literature and with datasets restricted to a company that appears to be open only in name.

Advertisement

Where next?

In the past decade, AI’s rapid advance has been in large part due to openness by academics and businesses alike. All the major AI tools we have are open-sourced.

But in the race to develop more capable AI, that may be ending. If openness in AI dwindles, we may see advances in this field slow down as a result. We may also see new monopolies develop.

And if history is anything to go by, we know a lack of transparency is a trigger for bad behaviour in tech spaces. So while we go on to laud (or critique) ChatGPT, we shouldn’t overlook the circumstances in which it has come to us.

Advertisement

Unless we’re careful, the very thing that seems to mark the golden age of AI may in fact mark its end. The Conversation

Toby Walsh, Professor of AI at UNSW, Research Group Leader, UNSW Sydney

This article is republished from The Conversation under a Creative Commons license. Read the original article.

Deborah Bloomfield
Deborah Bloomfield

Related posts:

  1. Apple updates the entry-level $329 iPad
  2. Canadian miner Teck considers sale, spinoff of $8 billion coal unit – Bloomberg News
  3. Commission chief tells Albania: your future is in the EU
  4. Bolshoi Theatre performer killed in accident on stage during opera

Source Link: Everyone’s Having A Field Day With ChatGPT – But Nobody Knows How It Actually Works

Filed Under: News

Primary Sidebar

  • Asteroid Day At 10: How The World Is More Prepared Than Ever To Face Celestial Threats
  • What Happened When A New Zealand Man Fell Butt-First Onto A Powerful Air Hose
  • Ancient DNA Confirms Women’s Unexpected Status In One Of The Oldest Known Neolithic Settlements
  • Earth’s Weather Satellites Catch Cloud Changes… On Venus
  • Scientists Find Common Factors In People Who Have “Out-Of-Body” Experiences
  • Shocking Photos Reveal Extent Of Overfishing’s Impact On “Shrinking” Cod
  • Direct Fusion Drive Could Take Us To Sedna During Its Closest Approach In 11,000 Years
  • Earth’s Energy Imbalance Is More Than Double What It Should Be – And We Don’t Know Why
  • We May Have Misjudged A Fundamental Fact About The Cambrian Explosion
  • The Shoebill Is A Bird So Bizarre That Some People Don’t Even Believe It’s Real
  • Colossal’s “Dire Wolves” Are Now 6 Months Old – And They’ve Doubled In Size
  • How To Fake A Fossil: Find Out More In Issue 36 Of CURIOUS – Out Now
  • Is It True Earth Used To Take 420 Days To Orbit The Sun?
  • One Of The Ocean’s “Most Valuable Habitats” Grows The Only Flowers Known To Bloom In Seawater
  • World’s Largest Digital Camera Snaps 2,104 New Asteroids In 10 Hours, Mice With 2 Dads Father Their Own Offspring, And Much More This Week
  • Simplest Explanation For “Anomalous” Signals Coming From Underneath Antarctica Ruled Out
  • “Lizard Shampoo” And Pagan Texts Suggest “Dark Age” Medicine Wasn’t So Dark After All
  • Japanese Macaques May Mourn Their Dead – As Long As They’re Not Maggot-Infested
  • This Is What You’d Hear If You Listened To Voyager’s Golden Record NASA Sent To Interstellar Space
  • RFK Jr’s New Vaccine Advisors Just Recommended Fall Flu Vaccines – But There’s A Catch
  • Business
  • Health
  • News
  • Science
  • Technology
  • +1 718 874 1545
  • +91 78878 22626
  • [email protected]
Office Address
Prudour Pvt. Ltd. 420 Lexington Avenue Suite 300 New York City, NY 10170.

Powered by Prudour Network

Copyrights © 2025 · Medical Market Report. All Rights Reserved.

Go to mobile version