1101

You know how Google's new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won't slide off (pssst...please don't do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of  AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

you are viewing a single comment's thread
view the rest of the comments
[-] RootBeerGuy@discuss.tchncs.de 59 points 5 months ago

I let you in on a secret: scientific literature has its fair share of bullshit too. The issue is, it is much harder to figure out its bullshit. Unless its the most blatant horseshit you've scientifically ever seen. So while it absolutely makes sense to say, let's just train these on good sources, there is no source that is just that. Of course it is still better to do it like that than as they do it now.

[-] givesomefucks@lemmy.world 35 points 5 months ago

The issue is, it is much harder to figure out its bullshit.

Google AI suggested you put glue on your pizza because a troll said it on Reddit once...

Not all scientific literature is perfect. Which is one of the many factors that will stay make my plan expensive and time consuming.

You can't throw a toddler in a library and expect them to come out knowing everything in all the books.

AI needs that guided teaching too.

[-] RidcullyTheBrown@lemmy.world 4 points 5 months ago

Google AI suggested you put glue on your pizza because a troll said it on Reddit once…

Genuine question: do you know that's what happened? This type of implementation can suggest things like this without it having to be in the training data in that format.

[-] ozymandias117@lemmy.world 9 points 5 months ago

In this case, it seems pretty likely. We know Google paid Reddit to train on their data, and the result used the exact same measurement from this comment suggesting putting Elmer’s glue in the pizza:

https://old.reddit.com/r/Pizza/comments/1a19s0/my_cheese_slides_off_the_pizza_too_easily/

And their deal with Reddit: https://www.cbsnews.com/news/google-reddit-60-million-deal-ai-training/

[-] assassin_aragorn@lemmy.world 4 points 5 months ago

It's going to be hilarious to see these companies eventually abandon Reddit because it's giving them awful results, and then they're completely fucked

[-] RidcullyTheBrown@lemmy.world 1 points 5 months ago

This doesn't mean that there are reddit comments suggesting putting glue on pizza or even eating glue. It just means that the implementation of Google's LLM is half baked and built it's model in a weird way.

[-] ozymandias117@lemmy.world 7 points 5 months ago* (last edited 5 months ago)

I literally linked you to the Reddit comment, and pointed out that Google’s response used the same measurements as the comment

Are you an LLM?

[-] RidcullyTheBrown@lemmy.world 5 points 5 months ago

Oh, hah sorry! thanks, I didn't realise that the reddit link pointed to the glue thing

[-] givesomefucks@lemmy.world 2 points 5 months ago

Genuine question: do you know that’s what happened?

Yes

[-] callouscomic@lemm.ee 10 points 5 months ago

"Most published journal articles are horseshit, so I guess we should be okay with this too."

[-] Turun@feddit.de 1 points 5 months ago

No, it's simply contradicting the claim that it is possible.

We literally don't know how to fix it. We can put on bandaids, like training on "better" data and fine-tune it to say "I don't know" half the time. But the fundamental problem is simply not solved yet.

this post was submitted on 27 May 2024
1101 points (100.0% liked)

Technology

59430 readers
2514 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS