574
Dawkin it for my AI (lemmy.world)

I'm pulling the "twitter is a microblog" rule even though twitter is pretty mega now, hope that's ok.

you are viewing a single comment's thread
view the rest of the comments
[-] thesmokingman@programming.dev 4 points 16 hours ago

Sorry, I assumed you would have actually read the DELEGATE-52 study linked instead of just the abstract. For “a model optimized for replacing StackOverflow” that is “better at writing papers than most students” LLMs sure did pretty bad at those tasks over multiple rounds.

[-] turdas@suppo.fi 1 points 16 hours ago

As the chart on page 7 of the paper shows, LLMs are good at exactly the kind of tasks you'd expect (producing and manipulating language), and bad at exactly the kind of tasks you'd expect (doing almost anything else). All this paper shows is that (1) they aren't AGI, and (2) as a consequence of not being AGI they aren't good unsupervised.

Why do you lie like this?

[-] thesmokingman@programming.dev 5 points 16 hours ago* (last edited 16 hours ago)

What the fuck? The only task that didn’t degrade across most models was Python. Very basic things like JSON, Makefiles, and schemas got screwed. Fiction, emails, and food menus got screwed. Did you even bother to read the legend? If you consider a single pass to be “producing and manipulating language” you didn’t bother to read the idiotic article you started this thread in support of. Good luck.

Edit: why do you lie?

Catastrophic corruption (80 and below) occurs in more than 80% of model, domain combinations.

[-] turdas@suppo.fi 1 points 16 hours ago

The only task that didn’t degrade across most models was Python.

Yeah, after 20 cycles of unsupervised iteration on the task. Gemini 3.1 Pro doing as well as it did under that experiment setup is quite remarkable actually.

The paper does not show what you are arguing.

this post was submitted on 03 May 2026
574 points (100.0% liked)

Microblog Memes

11443 readers
2534 users here now

A place to share screenshots of Microblog posts, whether from Mastodon, tumblr, ~~Twitter~~ X, KBin, Threads or elsewhere.

Created as an evolution of White People Twitter and other tweet-capture subreddits.

RULES:

  1. Your post must be a screen capture of a microblog-type post that includes the UI of the site it came from, preferably also including the avatar and username of the original poster. Including relevant comments made to the original post is encouraged.
  2. Your post, included comments, or your title/comment should include some kind of commentary or remark on the subject of the screen capture. Your title must include at least one word relevant to your post.
  3. You are encouraged to provide a link back to the source of your screen capture in the body of your post.
  4. Current politics and news are allowed, but discouraged. There MUST be some kind of human commentary/reaction included (either by the original poster or you). Just news articles or headlines will be deleted.
  5. Doctored posts/images and AI are allowed, but discouraged. You MUST indicate this in your post (even if you didn't originally know). If an image is found to be fabricated or edited in any way and it is not properly labeled, it will be deleted.
  6. Absolutely no NSFL content.
  7. Be nice. Don't take anything personally. Take political debates to the appropriate communities. Take personal disagreements & arguments to private messages.
  8. No advertising, brand promotion, or guerrilla marketing.

RELATED COMMUNITIES:

founded 2 years ago
MODERATORS