364
you are viewing a single comment's thread
view the rest of the comments
[-] RamRabbit@lemmy.world 82 points 1 day ago

the only way to block it is to get AI to differentiate instructions from data, which is impossible today

Input sanitation, basically security 101. And it can't currently do it....

[-] T156@lemmy.world 4 points 1 day ago* (last edited 1 day ago)

It's a text completion model/glorified Markov chain. Of course it can't input sanitise, it was never meant to do this to begin with.

The tool calling integrations that let it do more are basically making it add a markdown code block in JSON format into the user message, where the middleware intercepts it.

The input and "instructions" are the same thing from its perspective. There's nothing special that differentiates the two. The user input text, so it will output text, following the most likely sequence from its training.

[-] Reisen@sh.itjust.works 31 points 1 day ago

if the instruction is messy fuzzy human language to a system that was not coded instruction by instruction but got generated and trained then there never is a way to differentiate instructions from data if i'm not mistaken

[-] Catoblepas 43 points 1 day ago

Well, good thing we’ve only poured a trillion and a half dollars into it and wrecked the economy.

[-] schmorpel@slrpnk.net 17 points 1 day ago

I just can't anymore. Isn't that like, the basic thing any program does? Who runs these companies?

[-] partofthevoice@lemmy.zip 8 points 1 day ago

That’s also not the only way. Basic governance also works. Why does copilot have so many permissions?

[-] meco03211@lemmy.world 7 points 1 day ago

Little Bobby Tables strikes again.

[-] Cricket@lemmy.zip 5 points 1 day ago

I have heard in the past that it's not possible to fully control AI. Like literally, the people developing and running the AI cannot fully control its behavior. I did a quick search to see if I could find more info and found this link on the first page of results: https://www.eurekalert.org/news-releases/1032090

I think that we're going to continue seeing unwanted behavior from AI.

[-] NewNewAugustEast@lemmy.zip 7 points 1 day ago* (last edited 1 day ago)

Distinguished credentials, but at the same time I am not buying it. You can control AI. You can turn it off. You can have it not interact with systems you don't want.

Remember this guy is saying "you cant control AI, we are all doomed" while also saying that we live in a simulation and he is very close to being able to hack us out of it.

Grain of salt and all.

By the way his belief is thus "AI can't be contained, therefore the simulation can be escaped; by contraposition, if the simulation can't be escaped, AI can be contained" Since AI cant be contained, he reasons, we can escape the simulation, quite possibly by using a super AI!

There might be a reason he has a podcasts and visits Joe Rogan

[-] Cricket@lemmy.zip 1 points 17 hours ago

Thanks, I fully agree that AI can be controlled in the ways you mentioned. I think most of the discussion around AI not being fully controllable is in the context of if the AI is running as it currently is.

Thanks for the additional info too. I knew nothing about the guy in the link. It was just the first link I found on a quick search about AI not being controllable. I had heard it before, but didn't remember where, or the exact details.

this post was submitted on 31 Jul 2026
364 points (100.0% liked)

Technology

86790 readers
3508 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 3 years ago
MODERATORS