12
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 26 Oct 2024
12 points (100.0% liked)
AI
4110 readers
1 users here now
Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.
founded 3 years ago
Thats kinda is how neural networks actually function. They don't store massive amounts of data but, similar to us, tweak and adjust complex pathways of neurons that kinda just convert an input into a response.
When you ask an LLM a question you are actually getting a list of words based on probabilities, not anything the LLM had to "think about" before responding. During its training, different patterns fed to the AI tweak and balance how and when specific neurons should fire. One way to think about it is that "memories" or data is stored in how the paths are formed, not actually in the core of the neuron itself.
There are several hundred configurations of artificial neural networks that can mimic different functions of our brains, including memory.
Oh, so it’s mostly a side effect, but they are still primarily being trained to predict the next word.
Not necessarily, sometimes dimensionality reduction (the more common terminology used, for what is basically compression) is the explicit goal.
Can be used for outlier detection, similarity search, etc.
During training, you find a projection of the input, for example an image, to a smaller space, and then back to the original image. This is referred to as encoding and decoding. The error fuction would be a measure of how similar the in- and output images are.