60
AI agents wrong ~70% of time: Carnegie Mellon study (www.theregister.com)
submitted 3 weeks ago by MirchiLover@beehaw.org to c/technology@beehaw.org
3 comments fedilink hide all child comments
top 3 comments
sorted by: hot top controversial new old
[-] Kirk@startrek.website 9 points 3 weeks ago

This bit at the end, wow:

Gartner still expects that by 2028 about 15 percent of daily work decisions will be made autonomously by AI agents, up from 0 percent last year.

Agentic AI is wrong 70% of the time, but even assuming a human employee is barely correct most of the time and wrong 49% of the time, is it really still more efficient to replace them?

[-] JackEddyfier@beehaw.org 7 points 3 weeks ago

I'll start believing in AI when, and if, it's able to eliminate error. When will AI be able to work out whether the training material it used is true, fasle, myth, or other narrative?

[-] thebardingreen@lemmy.starlightkel.xyz 9 points 3 weeks ago* (last edited 3 weeks ago)

We tried to build systems that perform a kind of basic, rudimentary, extremely power intensive and inefficient mimicry of how (we think maybe) brain cells work.

Then that system lies to us, makes epic bumbling mistakes, expresses itself with extreme, overconfidence, and constantly creatively misinterprets simple instructions. It recognizes patterns that aren't there, and regurgitates garbage information that it picks up on the internet.

Hmmm... Actually, maybe we're doing a pretty good job of making systems that work similarly to the way brain cells work...

this post was submitted on 07 Jul 2025
60 points (100.0% liked)

Technology

39739 readers
174 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 3 years ago
MODERATORS
alyaza@beehaw.org
TheRtRevKaiser@beehaw.org
gyrfalcon@beehaw.org
rs5th@beehaw.org
coldredlight@beehaw.org
SemioticStandard@beehaw.org
TheRtRevKaiser@kbin.social
remington@beehaw.org