880
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 26 Jul 2023
880 points (100.0% liked)
Technology
59578 readers
2756 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
You know what would solve this? We all collectively agree this fucking tech is too important to be in the hands of a few billionaires, start an actual public free open source fully funded and supported version of it, and use it to fairly compensate every human being on Earth according to what they contribute, in general?
Why the fuck are we still allowing a handful of people to control things like this??
No entity on the planet has more money than our governments. It’d be more efficient for a government to fund this than any private company.
Many governments on the planet have less money than some big tech or oil companies. Obviously not those of large industrious nations, but most nations aren't large and industrious.
That's a lazy generalization.
Plenty of research shows that each dollar into government programs gets much more returns than private companies. This literally a neolib propaganda talking point.
Money literally does fall from trees as they are pieces of paper
Actually many bills are more of a fabric material now than an actual paper product. Many bills in Europe now are polymer based
Actually most of the money are just 1‘s and 0‘s in a computer, coming into existence from nothing and vanishing into nothing. Fiat money backed by "trust". As Henry Ford once said:
It is well enough that people of the nation do not understand our banking and monetary system, for if they did, I believe there would be a revolution before tomorrow morning.This comment is excellent. You now have ten trillion LemBux.
There is nothing objectively wrong with your statement. However, we somehow always default to solving that issue by having some dragon hoard enough gold, and there is something objectively wrong with that.
Setting aside the obvious answer of "because capitalism", there are a lot of obstacles towards democratizing this technology. Training of these models is done on clusters of A100 GPU's, which are priced at $10,000USD each. Then there's also the fact that a lot of the progress being made is being done by highly specialized academics, often with the resources of large corporations like Microsoft.
Additionally the curation of datasets is another massive obstacle. We've mostly reached the point of diminishing returns of just throwing all the data at the training of models, it's quickly becoming apparent that the quality of data is far more important than the quantity of the data (see TinyStories as an example). This means a lot of work and research needs to go into qualitative analysis when preparing a dataset. You need a large corpus of input, each of which are above a quality threshold, but then also as a whole they need to represent a wide enough variety of circumstances for you to reach emergence in the domain(s) you're trying to train for.
There is a large and growing body of open source model development, but even that only exists because of Meta "leaking" the original Llama models, and now more recently releasing Llama 2 with a commercial license. Practically overnight an entire ecosystem was born creating higher quality fine-tunes and specialized datasets, but all of that was only possible because Meta invested the resources and made it available to the public.
Actually in hindsight it looks like the answer is still "because capitalism" despite everything I've just said.
I know the answer to pretty much all of our “why the hell don’t we solve this already?” questions is: capitalism.
But I mean, as Lrrr would say “why does the working class, as the biggest of the classes, doesn’t just eat the other one?”.
The short answer is friction. The friction of overcoming the forces of violence the larger class has at its disposal and utilizes at the smallest hint of uprising is greater than the friction of accepting the status quo.
The friction of accepting the status quo only seems to grow stronger though.
One would hope
Most people don’t even think that’s an option though.
The end of history, with the fall of USSR and capitalism winning the propaganda wars, means most people don’t even see a different future.
Why would you fight a future that looks the same?
People need to wake up and have hope for a different, better future. That’s the only way they’ll more against this.
But for that 100+ years of propaganda have to be overcome…
For many many reasons, i'll start with this one: because if you don't complain with authority they will send their thugs (the police) to arrest you.
Because we shy away from responsibility.
I think the longer response to this is more accurate. It’s more “because capitalism” than anything else.
And capitalism over the course of the 20th century made very successful attempts of alienating completely the working class and destroying all class consciousness or material awareness.
So people keep thinking that the problems is we as individuals are doing capitalism wrong. Not capitalism.
You kind of can though? The bigger models aren't really more complicated, just bigger. If you can cram enough ram or swap into a laptop,
lamma.cppwill get there eventually.