1101

You know how Google's new feature called AI Overviews is prone to spitting out wildly incorrect answers to search queries? In one instance, AI Overviews told a user to use glue on pizza to make sure the cheese won't slide off (pssst...please don't do this.)

Well, according to an interview at The Vergewith Google CEO Sundar Pichai published earlier this week, just before criticism of the outputs really took off, these "hallucinations" are an "inherent feature" of  AI large language models (LLM), which is what drives AI Overviews, and this feature "is still an unsolved problem."

you are viewing a single comment's thread
view the rest of the comments
[-] givesomefucks@lemmy.world 377 points 6 months ago

They keep saying it's impossible, when the truth is it's just expensive.

That's why they wont do it.

You could only train AI with good sources (scientific literature, not social media) and then pay experts to talk with the AI for long periods of time, giving feedback directly to the AI.

Essentially, if you want a smart AI you need to send it to college, not drop it off at the mall unsupervised for 22 years and hope for the best when you pick it back up.

[-] Excrubulent@slrpnk.net 162 points 6 months ago

No he's right that it's unsolved. Humans aren't great at reliably knowing truth from fiction too. If you've ever been in a highly active comment section you'll notice certain "hallucinations" developing, usually because someone came along and sounded confident and everyone just believed them.

We don't even know how to get full people to do this, so how does a fancy markov chain do it? It can't. I don't think you solve this problem without AGI, and that's something AI evangelists don't want to think about because then the conversation changes significantly. They're in this for the hype bubble, not the ethical implications.

[-] dustyData@lemmy.world 84 points 6 months ago

We do know. It's called critical thinking education. This is why we send people to college. Of course there are highly educated morons, but we are edging bets. This is why the dismantling or coopting of education is the first thing every single authoritarian does. It makes it easier to manipulate masses.

[-] Excrubulent@slrpnk.net 59 points 6 months ago

"Edging bets" sounds like a fun game, but I think you mean "hedging bets", in which case you're admitting we can't actually do this reliably with people.

And we certainly can't do that with an LLM, which doesn't actually think.

[-] reagansrottencorpse@lemmy.ml 12 points 6 months ago

Jinx! You owe me an edge sesh!

[-] Excrubulent@slrpnk.net 11 points 6 months ago* (last edited 6 months ago)

A big problem with that is that I've noticed your username.

I wouldn't even do that with Reagan's fresh corpse.

[-] explore_broaden@midwest.social 5 points 6 months ago

I think that’s more a function of the fact that it’s difficult to verify that every one of the over 1M college graduates each year isn’t a “moron” (someone very bad about believing things other people made up). I think it would be possible to ensure a person has these critical thinking skills with a concerted effort.

[-] Excrubulent@slrpnk.net 5 points 6 months ago

The people you're calling "morons" are orders of magnitude more sophisticated in their thinking than even the most powerful modern AI. Almost every single one of them can easily spot what's wrong with AI hallucinations, even if you consider them "morons". And also, by saying you have to filter out the "morons", you're still admitting that a lot of whole real assed people are still not reliably able to sort fact from fiction regardless of your education method.

[-] explore_broaden@midwest.social 3 points 6 months ago

No I still agree that we are far from LLMs being ‘thinking’ enough to be anywhere near this. But if we had a bunch of models similar to LLMs that could actually think, or if we really needed to select a person, I do think it would be possible to evaluate a bunch of the models/people to determine which ones are good at distinguishing fake information.

All I’m saying is I don’t think the limitation is actually our ability to select for capability in distinguishing fake information, I think the only limitation is fundamental to how current LLMs work.

[-] Excrubulent@slrpnk.net 3 points 6 months ago

Yes, my point wasn't that it could never be achieved but that LLMs are in a completely different category, which we agree on I think. I was comparing them to humans who have trouble with critical thinking but can easily spot AI's hallucinations to illustrate the vast gulf.

In both cases I think there are almost certainly more barriers in the way than an education. The quest for a truthful AI will be as contentious as the quest for truth in humans, meaning all the same claim-counterclaim culture-war propaganda tug of war will happen, which I think is the main reason for people being miseducated against critical thinking. In a vacuum it might be a simple technical and educational challenge, but the reason this is a problem in the first place is that we don't exist in a political vacuum.

load more comments (2 replies)
[-] RidcullyTheBrown@lemmy.world 7 points 6 months ago

What does this have to do with AI and with what OP said? Their point was obviously about limitations of the software, not some lament about critical thinking

[-] scarabic@lemmy.world 2 points 6 months ago

Humans aren't great at reliably knowing truth from fiction too

You’re exactly right. There is a similar debate about automated cars. A lot of people want them off the roads until they are perfect, when the bar should be “until they are safer than humans,” and human drivers are fucking awful.

Perhaps for AI the standard should be “more reliable than social media for finding answers” and we all know social media is fucking awful.

load more comments (2 replies)
[-] RootBeerGuy@discuss.tchncs.de 59 points 6 months ago

I let you in on a secret: scientific literature has its fair share of bullshit too. The issue is, it is much harder to figure out its bullshit. Unless its the most blatant horseshit you've scientifically ever seen. So while it absolutely makes sense to say, let's just train these on good sources, there is no source that is just that. Of course it is still better to do it like that than as they do it now.

[-] givesomefucks@lemmy.world 35 points 6 months ago

The issue is, it is much harder to figure out its bullshit.

Google AI suggested you put glue on your pizza because a troll said it on Reddit once...

Not all scientific literature is perfect. Which is one of the many factors that will stay make my plan expensive and time consuming.

You can't throw a toddler in a library and expect them to come out knowing everything in all the books.

AI needs that guided teaching too.

[-] RidcullyTheBrown@lemmy.world 4 points 6 months ago

Google AI suggested you put glue on your pizza because a troll said it on Reddit once…

Genuine question: do you know that's what happened? This type of implementation can suggest things like this without it having to be in the training data in that format.

[-] ozymandias117@lemmy.world 9 points 6 months ago

In this case, it seems pretty likely. We know Google paid Reddit to train on their data, and the result used the exact same measurement from this comment suggesting putting Elmer’s glue in the pizza:

https://old.reddit.com/r/Pizza/comments/1a19s0/my_cheese_slides_off_the_pizza_too_easily/

And their deal with Reddit: https://www.cbsnews.com/news/google-reddit-60-million-deal-ai-training/

[-] assassin_aragorn@lemmy.world 4 points 6 months ago

It's going to be hilarious to see these companies eventually abandon Reddit because it's giving them awful results, and then they're completely fucked

[-] RidcullyTheBrown@lemmy.world 1 points 6 months ago

This doesn't mean that there are reddit comments suggesting putting glue on pizza or even eating glue. It just means that the implementation of Google's LLM is half baked and built it's model in a weird way.

[-] ozymandias117@lemmy.world 7 points 6 months ago* (last edited 6 months ago)

I literally linked you to the Reddit comment, and pointed out that Google’s response used the same measurements as the comment

Are you an LLM?

[-] RidcullyTheBrown@lemmy.world 5 points 6 months ago

Oh, hah sorry! thanks, I didn't realise that the reddit link pointed to the glue thing

[-] givesomefucks@lemmy.world 2 points 6 months ago

Genuine question: do you know that’s what happened?

Yes

[-] callouscomic@lemm.ee 10 points 6 months ago

"Most published journal articles are horseshit, so I guess we should be okay with this too."

[-] Turun@feddit.de 1 points 6 months ago

No, it's simply contradicting the claim that it is possible.

We literally don't know how to fix it. We can put on bandaids, like training on "better" data and fine-tune it to say "I don't know" half the time. But the fundamental problem is simply not solved yet.

[-] Zarxrax@lemmy.world 45 points 6 months ago

I'm addition to the other comment, I'll add that just because you train the AI on good and correct sources of information, it still doesn't necessarily mean that it will give you a correct answer all the time. It's more likely, but not ensured.

[-] RidcullyTheBrown@lemmy.world 15 points 6 months ago

Yes, thank you! I think this should be written in capitals somewhere so that people could understand it quicker. The answers are not wrong or right on purpose. LLMs don't have any way of distinguishing between the two.

[-] Leate_Wonceslace@lemmy.dbzer0.com 31 points 6 months ago

it's just expensive

I'm a mathematician who's been following this stuff for about a decade or more. It's not just expensive. Generative neural networks cannot reliably evaluate truth values; it will take time to research how to improve AI in this respect. This is a known limitation of the technology. Closely controlling the training data would certainly make the information more accurate, but that won't stop it from hallucinating.

The real answer is that they shouldn't be trying to answer questions using an LLM, especially because they had a decent algorithm already.

[-] Aceticon@lemmy.world 6 points 6 months ago* (last edited 6 months ago)

Yeah, I've learned Neural Networks way back when those thing were starting in the late 80s/early 90s, use AI (though seldom Machine Learning) in my job and really dove into how LLMs are put together when it started getting important, and these things are operating entirelly at the language level and on the probabilities of language tokens appearing in certain places given context and do not at all translate from language to meaning and back so there is no logic going on there nor is there any possibility of it.

Maybe some kind of ML can help do the transformation from the language space to a meaning space were things can be operated on by logic and then back, but LLMs aren't a way to do it as whatever internal representation spaces (yeah, plural) they use in their inners layers aren't those of meaning and we don't really have a way to apply logic to them).

[-] snooggums@midwest.social 4 points 6 months ago

So with reddit we had several pieces of information that went along with every post.

User, community along with up, and downvotes would inform the majority of users as to whether an average post was actually information or trash. It wasn't perfect, because early posts always got more votes and jokes in serious topics got upvotes, bit the majority of the examples of bad posts like glue on food came from joke subs. If they can't even filter results by joke sub, there is no way they will successfully handle saecasm.

Only basing results on actual professionals won't address the sarcasm filtering issue for general topics. It would be a great idea for a serious model that is intended to only return results for a specific set of topics.

[-] Leate_Wonceslace@lemmy.dbzer0.com 5 points 6 months ago

only return results for a specific set of topics.

This is true, but when we're talking about something that limited you'll probably get better results with less work by using human-curated answers rather than generating a reply with an LLM.

[-] snooggums@midwest.social 5 points 6 months ago

Yes, that would be the better solution. Maybe the humans could write down their knowledge and put it into some kind of journal or something!

[-] Excrubulent@slrpnk.net 3 points 6 months ago* (last edited 6 months ago)

You could call it Hyperpedia! A disruptive new innovation brought to us via AI that's definitely not just three encyclopedias in a trenchcoat.

[-] sudo42@lemmy.world 2 points 6 months ago

It’s worse than that. “Truth” can no more reliably found by machines than it can be by humans. We’ve spent centuries of philosophy trying to figure out what is “true”. The best we’ve gotten is some concepts we’ve been able to convince a large group of people to agree to.

But even that is shaky. For a simple example, we mostly agree that bleach will kill “germs” in a petri dish. In a single announcement, we saw 40% of the American population accept as “true” that bleach would also cure them if injected straight into their veins.

We’re never going to teach machine to reason for us when we meatbags constantly change truth to be what will be profitable to some at any given moment.

[-] Leate_Wonceslace@lemmy.dbzer0.com 2 points 6 months ago

Are you talking about epistemics in general or alethiology in particular?

Regardless, the deep philosophical concerns aren't really germain to the practical issue of just getting people to stop falling for obvious misinformation or people being wantonly disingenuous to score points in the most consequential game of numbers-go-up.

[-] vrighter@discuss.tchncs.de 20 points 6 months ago

no, the truth is it's impossible even then. If the result involves randomness at its most fundamental level, then it's not reliable whatever you do.

[-] jeeva@lemmy.world 8 points 6 months ago

That's just not how LLMs work, bud. It doesn't have understanding to improve, it just munges the most likely word next in line. It, as a technology, won't advance past that level of accuracy until it's a completely different approach.

[-] rambling_lunatic@sh.itjust.works 5 points 6 months ago

Or you could just not use LLMs for this.

[-] Canary9341@lemmy.ml 4 points 6 months ago

They could also perform some additional iterations with other models on the result to verify it, or even to enrich it; but we come back to the issue of costs.

[-] Excrubulent@slrpnk.net 10 points 6 months ago* (last edited 6 months ago)

Also once you start to get AI that reflects on its own information for truthfulness, where does that lead? Ultimately to determine truth you need to engage with the meaning of the words, and the process inherently involves a process of self-awareness. I would say you're talking about treaching the AI to understand context, and there is no predefined limit to the layers of context needed to understand the truthfulness of even basic concepts.

An AI that is aware of its own behaviour and is able to explore context as far as required to answer questions about truth, which would need that exploration precached in some sort of memory to reduce the overhead of doing this from first principles every time? I think you're talking about a mind; a person.

I think this might be a fundamental barrier, which I would call the "context barrier".

load more comments (1 replies)
[-] red@sopuli.xyz 4 points 6 months ago* (last edited 6 months ago)

The truth is, this is the perfect type of a comment that makes an LLM hallucinate. Sounds right, very confident, but completely full of bullshit. You can't just throw money on every problem and get it solved fast. This is an inheret flaw that can only be solved by something else than a LLM and prompt voodoo.

They will always spout nonsense. No way around it, for now. A probabilistic neural network has zero, will always have zero, and cannot have anything but zero concept of fact - only stastisically probable result for a given prompt.

It's a politician.

[-] givesomefucks@lemmy.world 1 points 6 months ago
[-] red@sopuli.xyz 4 points 6 months ago* (last edited 6 months ago)

No. another type of ML algorithm could, but not an LLM. They do not work like that.

[-] thefactremains@lemmy.world 2 points 6 months ago

Why not solve it before training the AI?

Simply make it clear that this tech is experimental, then provide sources and context with every result. People can make their own assessment.

[-] nyan@lemmy.cafe 13 points 6 months ago

Because a lot of people won't look at sources even if you serve them up on a silver platter?

[-] thefactremains@lemmy.world 3 points 6 months ago

It's better than not doing anything and pretending it's all accurate.

[-] nyan@lemmy.cafe 4 points 6 months ago

Yes, but as a solution it's far inferior to not presenting questionable output to the public at all.

(There are a few specific AI/LLM types whose output we might be able to "human-proof"—for instance, if we don't allow image generators to make photorealistic images of any sort for any purpose, they become much more difficult to abuse—but I can't see how you would do it for search engine adjuncts like this without having a human curate their training sets.)

[-] Excrubulent@slrpnk.net 2 points 6 months ago

Prompt injection has shown us that basically any attempt to limit the output like this is doomed to fail. Like anti-piracy ones, where if you ask directly for the info it says no, but if you ask for the info under the guise of avoiding it, it gives up everything.

Or for instance with the twitter bot, you could get it to regurgitate its own horrifically hateful prompt, then give it a replacement prompt and tell it to change its whole personality, then tell it to critique its previous prompt. There is currently no way to create a prompt that has supremacy over the user input. You can't ask it to keep a secret because it doesn't know what a secret is.

I think because we're getting access to hallucinations, it's a bit like telling a person "don't think about an elephant". Well, they just did, because you prompted them to with the instruction. LLMs similarly can't actually control what they output.

[-] scarabic@lemmy.world 1 points 6 months ago

I think you’re right that with sufficient curation and highly structured monitoring and feedback, these problems could be much improved.

I just think that to prepare an AI, in such a way, to answer any question reliably and usefully would require more human resources than there are elementary particles in the universe. We would be better off connecting live college educated human operators to Google search to individually assist people.

So I don’t know how helpful it is to say “it’s just expensive” when the entire point of AI is to be lower cost than a battalion of humans.

this post was submitted on 27 May 2024
1101 points (100.0% liked)

Technology

59974 readers
2258 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS