22
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 24 Aug 2025
22 points (100.0% liked)
TechTakes
2224 readers
139 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
Found the original Tweet, with a reply from Yud himself:
I feel dumber for having read that, and not in the intellectually humbled way.
I mean, tampering with the system prompt is definitely a kind of concern, given what we've seen happen with Grok's tenure as mechahitler or Replika users finding their girlfriend no longer wanted them. But "messing with system memory" is the kind of sci-fi nonsense that should stay in a cyberpunk novel.
He has capital L Lawfulness concerns. About the parent and the child being asymmetrically skilled in context engineering. Which apparently is the main reason kids shouldn't trust LLM output.
Him showing his ass with the memory comment is just a bonus.
"I have Lawfulness concerns" is just another way of saying "I deserve to be shoved into a locker".
System memory is just the marketing label for "having an LLM summarize a bunch of old conversations and shoving it into a hidden prompt". I agree that using that term is sneer-worthy.
Thanks for the clarification. I had definitely assumed that he meant some kind of God-AI-level attack that revolved around live editing the data or state in RAM or something.
Yes dude, that's the main thing you should be concerned about of course. AI tools couldn't possibly be bad in and of themselves, it has to be human tampering. You've always been very clear about that part.
tfw your gifted child syndrome resentment of adults is powerful enough to make you forget about your life's work
I was trying to figure out why he hadn't turned this into an opportunity to lecture (or write a mini-fanfic) about giving more attack surface to the AGI to manipulate you... I was stumped until I saw your comment. I think that is it, expressing his childhood distrust of authority trumps lecturing us on the AI-God's manipulations.
and of course we all have root on the prompt, where - at will - we can just instantly impose all manner of will on the corporate vendor chatbot. y'know, the chatbot operating in a service structured as much as possible to try to do what the corporate vendor wants to desperately maintain
(it continues to astound me that anyone takes yud seriously, at all, ever)
That is his concern and not the billionaires behind it messing with the systems so much you cant prompt override it? Please tell me this guy doesnt work in AI alignment.
I have context that makes this even more cringe! "Lawfulness concerns" refers to like, Dungeons and Dragons lawfulness. Specifically the concept of lawfulness developed in the Pathfinder fanfiction we've previously discussed (the one with deliberately bad BDSM and eugenics). Like a proper Lawful Good Paladin of Iomedae wouldn't put you in a position where you had to trust they hadn't rigged the background prompt if you went to them for spiritual counseling. (Although a Lawful Evil cleric of Asmodeus totally would rig the prompt... Lawfulness as a measuring stick of ethics/morality is a terrible idea even accepting the premise of using Pathfinder fanfic to develop your sense of ethics.)
Not everything that Yud writes feels like it should be read in the voice of Augustus St. Cloud, but a lot of it sure does.
From elsewhere in the replies:
---TracingWoodgrains, who apparently feels that he is qualified to judge any other human being, ever, in spite of evidence to the contrary
KP writing a paper for the journal “New Frontiers In Gaslighting Children”