The bill mandates safety testing of advanced AI models and the imposition of “guardrails” to ensure they can’t slip out of the control of their developers or users and can’t be employed to create “biological, chemical, and nuclear weapons, as well as weapons with cyber-offensive capabilities.” It’s been endorsed by some AI developers but condemned by others who assert that its constraints will drive AI developers out of California.

Man, if I can't even build homemade nuclear weapons, what CAN I do? That's it, I'm moving to Nevada!

ngl his stuff always felt a bit cynical to me, in that it seemed to exist more to say "look, video games can have a deep message!" than it did to just have such a message in the first place. Like it existed more to gesture at the concept of meaningfulness rather than to be meaningful itself.

I believe waitbutwhy came up before on old sneerclub though in that case we were making fun of them for bad political philosophy rather than bad ai takes

It is always kind of bewildering to me though. Like, has no one ever explained to these people the health problems that highly-bred dogs tend to have? Have they never heard of 'hybrid vigor' or issues with smaller gene pools making populations more susceptible to disease? Were they just asleep during biology 101? I don't get how people who think they're so smart can have failed to consider even the most basic issues with planning to turn humanity into Gros Michel bananas.

ok but for real... it's not great for finding actual answers to queries, but I find like 800x more interesting results with search.marginalia.nu than any other search engine. It's the only search engine that I find actively fun to just browse around on recreationally.

I'm confused how this is even supposed to demonstrating "metacognition" or whatever? It's not discussing its own thought process or demonstrating awareness of its own internal state, it just said "this sentence might have been added to see if I was paying attention." Am I missing something here? Is it just that it said "I... paying attention"?

This is a thing humans already do sometimes in real life and discuss -- when I was in middle school, I'd sometimes put the word "banana" randomly into the middle of my essays to see if the teacher noticed -- so pardon me if I assume the LLM is doing this by the same means it does literally everything else, i.e. mimicking a human phrasing about a situation that occurred, rather than suddenly developing radical new capabilities that it has never demonstrated before even in situations where those would be useful.

I feel like it was all over from the moment they made it talk in first person. No one had any illusions that Inferkit or NovelAI were general intelligences, because it was obvious that they were just language models autocompleting a sentence you typed in.

since we both have the High IQ feat you should be agreeing with me, after all we share the same privileged access to absolute truth. That we aren’t must mean you are unaligned/need to be further cleansed of thetans.

They have to agree, it's mathematically proven by Aumann's Agreement Theorem!

This is good! Though, he neglects to mention the group of people (including myself) who have yet to be sold on ai's usefulness at all (all critics of practical AI harms are lumped under 'reformers' implying they still see it as valuable but just currently misguided.)

Like, ok, so what if China develops it first? Now they can... generate more convincing spam, write software slightly faster with more bugs, and starve all their artists to death? ... Oh no, we'd better hurry up and compete with that!

we can only hope that nothing continues to happen everywhere else. our only hope is to contain the infection to SF, LA, and DC before it's too late

Love the reply saying "eh, I disagree -- LA's not that important, it's really just SF and DC"