197
How good is your intuition? (piefed.cdn.blahaj.zone)
you are viewing a single comment's thread
view the rest of the comments
[-] Grail@multiverse.soulism.net 2 points 1 hour ago

They organise tokens into groups based on statistical probability, and convert those tokens into words and sentences.

Yeah, that's the way your brain works when you're not paying attention. That's why your dreams are like that. It's just a bunch of vaguely probable stuff based on your daily experiences.

humans can not summarise or read or understand a probability matrix with many billions of parameters.

Uhhhhh, yeah they can. The human brain has 86 billion neurons. If you put all 86 billion of those neurons and their connections into a matrix, you get a mathematical representation of the human brain's information processing. You're running the calculations on all 86 billion neuron matrix every second, manually, one neuron at a time.

Like, I'm guessing you're not really a math person, so let Me explain in simple terms: multiplication is just a shorter way to do addition, right? 6 * 5 is just 6+6+6+6+6, collapsed down. So if you have a 10 year old kid who can count out all the numbers one by one, and a computer that knows some computational tricks to figure out 6 * 5, that's the same, right?

So your neurons in your brain are biological computers, and that makes them really energy efficient. Electronic computers kinda suck at that efficient stuff. So where your neurons can manually calculate 86 billion parameters many times a second, a computer has to use shortcuts. And vector cross-multiplication is just a more efficient way for a computer to calculate neuron firings. The abstract mathematical operations are the same in principle.

Now there are a lot of differences between your brain and an LLM, and I'll be happy to explain them. But matrix multiplication is not one of them. That's stinky nonsense.

[-] im_fine_sandy@nord.pub 1 points 35 minutes ago

Humans can not read or understand the probability matrix in which an LLM stores its parameters.

[-] Grail@multiverse.soulism.net 1 points 22 minutes ago

Neither can an LLM. Try asking ChatGPT to run a matrix cross-multiplication, it sucks as badly as if you tried to do it without any paper.

[-] im_fine_sandy@nord.pub 1 points 1 minute ago

An LLM can't read the matrix in which it stores its own parameters?

That's like saying a human can't read the neurons in their own brain. Sure, looking at them through a microscope, we can not.

You don't seem to have any idea what you're talking about.

this post was submitted on 22 Aug 2026
197 points (100.0% liked)

Autism

10285 readers
297 users here now

This is a community for people with Autism to be themselves. All neurotypes are welcome.

Community:

Values

  • Acceptance
  • Openness
  • Understanding
  • Equality
  • Reciprocity
  • Mutuality
  • Love

Rules

  1. No abusive, derogatory, or offensive post/comments e.g: racism, sexism, religious hatred, homophobia, gatekeeping, trolling.
  2. Posts do not need be related to autism, off-topic discussions are allowed. This is a safe space where people with autism can feel comfortable discussing whatever they feel like discussing, as long as it does not violate the standing rules.
  3. Your posts must include a text body. It doesn't have to be long, it just needs to be descriptive.
  4. Do not request donations.
  5. Be respectful in discussions.
  6. Do not post misinformation.
  7. Mark NSFW content accordingly.
  8. Do not promote Autism Speaks.
  9. General Lemmy World rules.
  10. No bots. Humans only.

Encouraged

  1. Open acceptance of all autism levels as a respectable neurotype.
  2. Funny memes.
  3. Respectful venting.
  4. Describe posts of pictures/memes using text in the body for our visually impaired users.
  5. Welcoming and accepting attitudes.
  6. Questions regarding autism.
  7. Questions on confusing situations.
  8. Seeking and sharing support.
  9. Engagement in our community's values.
  10. Expressing a difference of opinion without directly insulting another user.
  11. Please report questionable posts and let the mods deal with it.

.

Helpful Resources

founded 3 years ago
MODERATORS