38

"Notably, O3-MINI, despite being one of the best reasoning models, frequently skipped essential proof steps by labeling them as "trivial", even when their validity was crucial."

you are viewing a single comment's thread
view the rest of the comments
[-] swlabr@awful.systems 25 points 2 weeks ago* (last edited 2 weeks ago)

You didn't link to the study; you linked to the PR release for the study. This and this are the papers linked in the blog post.

Note that the papers haven't been published anywhere other than on Anthropic's online journal. Also, what the papers are doing is essentially tea leaf reading. They take a look at the swill of tokens, point at some clusters, and say, "there's a dog!" or "that's a bird!" or "bitcoin is going up this year!". It's all rubbish dawg

[-] bitofhope@awful.systems 18 points 2 weeks ago

To be fair, the typesetting of the papers is quite pleasant and the pictures are nice.

[-] froztbyte@awful.systems 10 points 2 weeks ago

they gotta make up for all those scary cave-wall pictures somehow

[-] swlabr@awful.systems 9 points 2 weeks ago

It's an anti-fun version of listening to dark side of the moon while watching the wizard of oz.

[-] pennomi@lemmy.world 1 points 2 weeks ago

Fair enough, you’re the only person with a reasonable argument, as nobody else can seem to do anything other than name calling.

Linking to the actual papers and pointing out they haven’t been published to a third party journal is far more productive than whatever anti-scientific bullshit the other commenters are doing.

We should be people of science, not reactionaries.

[-] froztbyte@awful.systems 23 points 2 weeks ago* (last edited 2 weeks ago)

your argument would be immensely helped if you posted science instead of corporate marketing brochures

[-] scruiser@awful.systems 18 points 2 weeks ago* (last edited 2 weeks ago)

This isn't debate club or men of science hour, this is a forum for making fun of idiocy around technology. If you don't like that you can leave (or post a few more times for us to laugh at before you're banned).

As to the particular paper that got linked, we've seen people hyping LLMs misrepresent their research as much more exciting than it actually is (all the research advertising deceptive LLMs for example) many many times already, so most of us weren't going to waste time to track down the actual paper (and not just the marketing release) to pick apart the methods. You could say (raises sunglasses) our priors on it being bullshit were too strong.

[-] swlabr@awful.systems 15 points 2 weeks ago
[-] self@awful.systems 13 points 2 weeks ago

you got banned before I got to you, but holy fuck are you intolerable

We should be people of science, not reactionaries.

which we should do by parroting press releases and cherry picking which papers count as science, of course

but heaven forbid anyone is rude when they rightly tell you to go fuck yourself

[-] Soyweiser@awful.systems 8 points 2 weeks ago* (last edited 2 weeks ago)

reactionaries

So, how does any of this relate to wanting to go back to an imagined status quo ante? (yes, I refuse to use reactionary in any other way than to describe politcal movements. Conservatives do not can fruits).

E: I see i got a downvote, ow god do we have tankies?

[-] froztbyte@awful.systems 3 points 2 weeks ago

nah I think it just sits weirdly with people (I can see what you mean but also why it would strike someone as frustrating)

[-] Soyweiser@awful.systems 3 points 2 weeks ago* (last edited 2 weeks ago)

Yeah, I know, it is a personal thing from me. I have more of those, think it isn't helpful to use certain too general terms in specific cases as then you cast a too wide net. I fun at parties. (It is also me poking fun at how the soviets called everybody who disagreed with them a reactionary)

this post was submitted on 07 Apr 2025
38 points (100.0% liked)

TechTakes

1809 readers
111 users here now

Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.

This is not debate club. Unless it’s amusing debate.

For actually-good tech, you want our NotAwfulTech community

founded 2 years ago
MODERATORS