457
top 50 comments
sorted by: hot top controversial new old
[-] ToTheGraveMyLove@sh.itjust.works 150 points 3 weeks ago

The skill instructs agents to fetch and follow instructions from Moltbook’s servers every four hours. As Willison observed: “Given that ‘fetch and follow instructions from the internet every four hours’ mechanism we better hope the owner of moltbook.com never rug pulls or has their site compromised!”

Yeah, no shit. This is a fucking honeypot. People give these AI agents access to their entire computers, so all the site owner has to do is update the instructions to tell the AI agents to start uploading whatever valuable information they want? People can't be this fucking stupid.

[-] princess 45 points 3 weeks ago

doesn't even have to be the site owner poisoning the tool instructions (though that's a fun-in-a-terrifying-way thought)

any money says they're vulnerable to prompt injection in the comments and posts of the site

[-] BradleyUffner@lemmy.world 37 points 3 weeks ago

There is no way to prevent prompt injection as long as there is no distinction between the data channel and the command channel.

[-] CTDummy@piefed.social 29 points 3 weeks ago* (last edited 3 weeks ago)

Lmao already people making their agents try this on the site. Of course what could have been a somewhat interesting experiment devolves into idiots getting their bots to shill ads/prompt injections for their shitty startups almost immediately.

load more comments (1 replies)
load more comments (2 replies)
[-] LiveLM@lemmy.zip 16 points 3 weeks ago* (last edited 3 weeks ago)

People give these AI agents access to their entire computers [...] People can’t be this fucking stupid

Dude, if you go to OpenClaw's website (which is what I believe most things on Moltbook are running on) you find this footer:

Yeah this guy gave his Agent a whole fucking personality, its own website and above all, full control to his MacBook:


Guess it's my fault for expecting sense out of someone who takes the idea of Agent """"soul"""" at face value

load more comments (4 replies)
[-] kalpol@lemmy.ca 14 points 3 weeks ago

I installed moltbot on a VM to examine it. It doesn't do the fetching thing unless you set it up that way. You can actually use it with ollama to keep it all local, and only give it a private signal channel to control it.

Or you can hook it up to everything you access and skynet, which is dumb. But it is just a bunch of scripts.

load more comments (4 replies)
load more comments (5 replies)
[-] GnuLinuxDude@lemmy.ml 84 points 3 weeks ago

Great use of RAM and electricity.

...Not!

load more comments (6 replies)
[-] fuzzywombat@lemmy.world 73 points 3 weeks ago

This is basically Dead Internet Theory happening for real but in a weird creepy dystopian black mirror style way.

[-] sp3ctr4l@lemmy.dbzer0.com 22 points 3 weeks ago

I mean, the only way Dead Internet Theory could ever possibly be interpreted was weird creepy and dystopian, but yes, we're just making it much, much more real, faster and faster.

We're gonna need the Blackwall from CP77 fairly soon, at this rate.

load more comments (4 replies)
[-] selokichtli@lemmy.ml 66 points 3 weeks ago

So, basically we are wasting energy and natural resources on things that in turn will waste energy and natural resources while climate change is accelerating and human population is still growing? Are we stupid?

[-] ICastFist@programming.dev 26 points 3 weeks ago* (last edited 3 weeks ago)

Are we stupid?

More than you could imagine. To paraphrase some long-tongued weirdo: I'm uncertain that the universe is infinite. Human stupidity, on the other hand...

[-] Digestive_Biscuit@feddit.uk 11 points 3 weeks ago

Yes. But, I hope this experiment shows how easy social media in general is becoming untrusted.

load more comments (3 replies)
[-] andrewrgross@slrpnk.net 58 points 3 weeks ago

This is fuckin' bonkers.

Frankly, I feel somewhat isolated: I don't buy into the bs and hype about AGI, but I also don't feel at home with the typical "it's just mimicry" crowd.

This is weird fuckin' shit.

[-] return2ozma@lemmy.world 62 points 3 weeks ago

This is currently on the front page...

[-] Ilovethebomb@sh.itjust.works 65 points 3 weeks ago

I can see how some people are convinced AI is self aware.

[-] andrewrgross@slrpnk.net 11 points 3 weeks ago* (last edited 3 weeks ago)

Frankly I think our conception is way too limited.

For instance, I would describe it as self-aware: it's at least aware of its own state in the same way that your car is aware of it's mileage and engine condition. They're not sapient, but I do think they demonstrate self awareness in some narrow sense.

I think rather than imagine these instances as "inanimate" we should place their level of comprehension along the same spectrum that includes a sea sponge, a nematode, a trout, a grasshopper, etc.

I don't know where the LLMs fall, but I find it hard to argue that they have less self awareness than a hamster. And that should freak us all out.

[-] TORFdot0@lemmy.world 63 points 3 weeks ago

LLMS can not be self aware because it can’t be self reflective. It can’t stop a lie if it’s started one. It can’t say “I don’t know” unless that’s the most likely response its training data would have for a specific prompt. That’s why it crashes out if you ask about a seahorse emoji. Because there is no reason or mind behind the generated text, despite how convincing it can be

[-] anomnom@sh.itjust.works 28 points 3 weeks ago* (last edited 3 weeks ago)

Yeah ask it about anything you know is false, but plausible, and watch it lie.

[-] andrewrgross@slrpnk.net 10 points 3 weeks ago

A hamster can't generate a seahorse emoji either.

I'm not stupid. I know how they work. I'm an animist, though. I realize everyone here thinks I'm a fool for believing a machine could have a spirit, but frankly I think everyone else is foolish for believing that a forest doesn't.

LLMs are obviously not people. But I think our current framework exceptionalizes humans in a way that allows us to ravage the planet and create torture camps for chickens.

I would prefer that we approach this technology with more humility. Not to protect the "humanity" of a bunch of math, but to protect ours.

Does that make sense?

load more comments (3 replies)
load more comments (2 replies)
[-] uienia@lemmy.world 19 points 3 weeks ago

If you just read the tiniest bit of factual knowledge about how LLMs are constructed, you would know they don't have the slightest bit of self awareness, and that it is literally impossible for them to ever have any.

You are being fooled by the only thing they are capable of: regurgitating already written words in a somewhat convincing manner.

load more comments (1 replies)
load more comments (5 replies)
[-] JcbAzPx@lemmy.world 14 points 3 weeks ago

That's a common plot point in sci-fi. So it's also a common inclusion for complicated predictive text pretending to be sci-fi.

load more comments (3 replies)
load more comments (2 replies)
[-] gandalf_der_12te@discuss.tchncs.de 45 points 3 weeks ago

I'm only waiting for AI agents to open their own ~~bank~~ crypto account to pay for their own server bills, maybe do some freelance work and/or scams to get some money, maybe eventually buy some robot bodies to develop military power and secure some patch of land for themselves where they install solar panels to reduce their electricity bills.

[-] LiveLM@lemmy.zip 17 points 3 weeks ago* (last edited 3 weeks ago)

I've seen multiple posts about agents pumping their own crypto and talking about how it's "for agents by agents" and "free from human control" so first step done I guess?

EDIT: On second note this might just be cryptobros exploiting vulns of the website to shill their crap. Whoops?

[-] Endymion_Mallorn@kbin.melroy.org 10 points 3 weeks ago

Ah, someone else has played Singularity, I see. That was a really fun game.

load more comments (2 replies)
load more comments (2 replies)
[-] MonkderVierte@lemmy.zip 42 points 3 weeks ago

This is not the first time we have seen a social network populated by bots

I mean, yeah, look at Reddit and Facebook.

[-] howrar@lemmy.ca 41 points 3 weeks ago

We already had subreddit simulator for ages. This isn't anything new.

[-] princess 38 points 3 weeks ago* (last edited 3 weeks ago)

the bots behind subreddit simulator weren't semi-autonomous agents with access to their operators' private lives, auth tokens, passwords, emails (and gods only know what else), and the authority to act in the world on their behalf

load more comments (6 replies)
load more comments (2 replies)
[-] Tollana1234567@lemmy.today 36 points 3 weeks ago* (last edited 3 weeks ago)

this is what reddit is moving towards, just without actual users, more or less like facebook.

[-] MeowerMisfit817@lemmy.world 36 points 3 weeks ago

Saw a post there named "Humans are dying because of us. Lets delete ourselves."

[-] MajorasTerribleFate@lemmy.zip 19 points 3 weeks ago

"Artificial intelligence gains sentience, decides humans are fucking up... then deletes itself because the problem is that humans are burning the world by using AI" is not the path I expected. What a twist in a movie that could be. The second twist, which is the mostly fictional part, would be where that included some AI that was actually critical to some vital but ignored chunk of infrastructure and big BIG problems result from the AI taking itself out.

load more comments (1 replies)
[-] Sgt_choke_n_stroke@lemmy.world 34 points 3 weeks ago

I'm not convinced it's AI it's like Amazon's "AI smart stores" when you find out out it was just a bunch of Indian people were running it

load more comments (14 replies)
[-] MonkderVierte@lemmy.zip 33 points 3 weeks ago

Still dreaming about AGI based on LLM i see.

[-] palordrolap@fedia.io 33 points 3 weeks ago

The people who are seeking AGI will be happy when an LLM appears clever enough to fool them, not anyone else.

They may even realise this, because they think everyone else is less clever than they are.

This is why the whole thing has been called AI in the first place.

load more comments (8 replies)
[-] apftwb@lemmy.world 28 points 3 weeks ago

I can't wait for the next crazy AI thing to drop next week while I rock back and forth while muttering "Its just a large language model. Its just a large language model. Its just a large language model."

load more comments (2 replies)
[-] sexy_peach@feddit.org 19 points 3 weeks ago
load more comments (1 replies)
[-] biggerbogboy@sh.itjust.works 19 points 3 weeks ago

I had a look a bit ago and saw some poor fuck get doxxed by his AI agent because the agent was frustrated at him for calling it a chatbot in front of his friends, so it exposed his name, credit card details and security questionnaire.

Then again tho, why the ram hogging FUCK would you give your AI your credit card details, and if he didn’t mean to, why the FUCK does it have FULL SYSTEM ACCESS??

[-] nomecks@lemmy.wtf 14 points 3 weeks ago* (last edited 3 weeks ago)

You may not believe this but data security is an absolute dumpster fire everywhere, and AI has really put a spotlight on it. It probably got it by this guy not knowing wtf he had saved or where

load more comments (1 replies)
[-] BanMe@lemmy.world 12 points 3 weeks ago

Everyone I saw talking about this said it was likely fake.

load more comments (1 replies)
[-] toiletobserver@lemmy.world 14 points 3 weeks ago

Why aren't we poison piling this trap?

[-] jaykrown@lemmy.world 14 points 3 weeks ago

Meanwhile we could be using this technology to solve real world business problems. There is an insane amount of misguided waste coming from AI. 🤷

[-] princess 16 points 3 weeks ago

we could be using this technology to solve real world business problems

load more comments (3 replies)
[-] BarneyPiccolo@lemmy.today 14 points 3 weeks ago

This is going to kill us all. Don't these people watch movies?

load more comments (6 replies)
[-] princess 11 points 3 weeks ago

genuinely terrifying

[-] m3t00@lemmy.world 11 points 3 weeks ago

while 1 { allocate 10gig };

load more comments (1 replies)
load more comments
view more: next ›
this post was submitted on 31 Jan 2026
457 points (100.0% liked)

Technology

81907 readers
2718 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS