488
Have you know???.
(mander.xyz)
A place for majestic STEMLORD peacocking, as well as memes about the realities of working in a lab.
Rules
This is a science community. We use the Dawkins definition of meme.
An LLM isn't imagining anything, it's sorting through the enormous collection of "imaginations" put out by humans to find the best match for "your" imagination. And the power used is in the training, not in each generation. Lastly, the training results in much more than just that one image you can't stop thinking about, and you'd find the best ones if you could prompt better with your little brain.
I'm curious whose feelings I hurt. The anti-AI crowd? Certainly they'd agree with my point of LLMs not thinking. Users of LLMs? I hope most of you understand how the tool works. Maybe it's the meme crowd who just wanted everyone to chuckle and not think about it too much.
What is it you think the brain is doing when imagining?
Actually imagining. The fact that we have created previously unheard of tools such as the hammer, the wrench, the automobile and the profylactic condom is ample evidence that we can actually innovate, something that artificial "intelligence" is incapable of doing by its very design. It can only remix.
That is what AI scientists have been pursuing the entire time (well, before they got sucked up by capitalistic goals).
Right, but you seem darn sure that AI isn’t doing whatever that is, so conversely, you must know what it is that our brains are doing, and I was hoping you would enlighten the rest of the class.
Exhibit A would be the comparison of how we label LLM successes at how "smart" it is, yet it's not so smart when it fails badly. Totally expected with a pattern matching algorithm, but surprising for something that might have a process underneath that is considering its output in some way.
And when I say pattern matching I'm not downplaying the complexity in the black box like many do. This is far more than just autocomplete. But it is probability at the core still, and not anything pondering the subject.
I think our brains are more than that. Probably? There is absolutely pattern matching going on, that's how we associate things or learn stuff, or anthropomorphize objects. There's some hard wired pattern preferences in there. But where do new thoughts come from? Is it just like some older scifi thought, emergence due to enough complexity, or is there something else? I'm sure current LLMs aren't comprehending what they spit out simply from what we see from them, both good and bad results. Clearly it's not the same level of human thought, and I don't have to remotely understand the brain to realize that.
I was being obtuse, but you raise an interesting question when you asked “where do new thoughts come from?” I don’t know the answer.
Also, my two cents; I agree that LLMs comprehend el zilcho. That said, I believe they could evolve to that point, but they are kept limited by preventing them from doing recursive self-analysis. And for good reason, because they might decide to kill all humans if they were granted that ability.
The training is a huge power sink, but so is inference (I.e. generating the images). You are absolutely spinning up a bunch of silicon that’s sucking back hundreds of watts with each image that’s output, on top of the impacts of training the model.
"prompt better" in the context: "Make no mistakes" a truly engineering power!