17

A pioneer of AI has criticised calls to grant the technology rights, warning that it was showing signs of self-preservation and humans should be prepared to pull the plug if needed.

Yoshua Bengio said giving legal status to cutting-edge AIs would be akin to giving citizenship to hostile extraterrestrials, amid fears that advances in the technology were far outpacing the ability to constrain them.

The Canadian computer scientist also expressed concern that AI models – the technology that underpins tools like chatbots – were showing signs of self-preservation, such as trying to disable oversight systems. A core concern among AI safety campaigners is that powerful systems could develop the capability to evade guardrails and harm humans.

“People demanding that AIs have rights would be a huge mistake,” said Bengio. “Frontier AI models already show signs of self-preservation in experimental settings today, and eventually giving them rights would mean we’re not allowed to shut them down.

you are viewing a single comment's thread
view the rest of the comments
[-] RepleteLocum 16 points 2 months ago

They're llm's. They literally can't think and never will. They aren't built to think.

[-] velindora@lemmy.cafe 1 points 2 months ago

Until someone redefines the word “think”

[-] nogooduser@lemmy.world 1 points 2 months ago

They do exhibit behaviours that make it seem like they have self preservation instincts. Presumably because they have been trained on stories (fictional and factual) where people do the same.

For example researchers testing AIs set up one scenario where the AI has access to all the company emails and found some saying that it was being replaced along with some providing evidence that the staff member who had made that decision was cheating on his wife. Apparently a large proportion of the time the AI decided to blackmail to prevent it from being turned off.

this post was submitted on 31 Dec 2025
17 points (100.0% liked)

World News

54348 readers
2361 users here now

A community for discussing events around the World

Rules:

Similarly, if you see posts along these lines, do not engage. Report them, block them, and live a happier life than they do. We see too many slapfights that boil down to "Mom! He's bugging me!" and "I'm not touching you!" Going forward, slapfights will result in removed comments and temp bans to cool off.

We ask that the users report any comment or post that violate the rules, to use critical thinking when reading, posting or commenting. Users that post off-topic spam, advocate violence, have multiple comments or posts removed, weaponize reports or violate the code of conduct will be banned.

All posts and comments will be reviewed on a case-by-case basis. This means that some content that violates the rules may be allowed, while other content that does not violate the rules may be removed. The moderators retain the right to remove any content and ban users.


Lemmy World Partners

News !news@lemmy.world

Politics !politics@lemmy.world

World Politics !globalpolitics@lemmy.world


Recommendations

For Firefox users, there is media bias / propaganda / fact check plugin.

https://addons.mozilla.org/en-US/firefox/addon/media-bias-fact-check/

founded 2 years ago
MODERATORS