We're destroying the environment for this folks
Except for local LLMS.
No one in this post about Google is talking about local LLMs.
i was trying to say Local LLMS dont destroy the environment(cause its using the power of your pc instead)
Training the models still uses a vast amount of resources
well atleast every prompt you ask it wont harm the environment
If you are browsing Piefed you are probably using about 10-20% of your computer's resources (if it is a computer capable of running a 4B model).
When you question the model and it pegs your system out, that is between 5 and 10 TIMES more resource utilization and power waste just to have a question answered that you could have taken the time to research, improve your own critical thinking skills, and learned something without changing your utilization at all.
Not counting the training debt.
i forgot about critical thinking, hehe.
but i hope my use of AI doesnt ruin it that much.
btw the best respones here.
"I'm not the one deforesting the amazon but I really love teak furniture, so I'M not the one hurting anybody by buying it"
Your computer uses more power when the GPU is "thinking" than when its idle, so there would still be environmental damage.
No? If everyone who uses LLMs globally switched over to a local LLM (after buying the necessary hardware), that'd still be a crazy amount of energy usage, just less centralised.
More energy actually.
nah like using the current Gaming PC/Laptop you have, Like Intel CPU + intergrated graphics or smth.
I suppose, but that's a very different class of model. I think a more important question might be whether people actually need LLMs at all.
whether people actually need LLMs at all.
this is personal preference ig.
What I'm saying is that not all local LLMs are more power efficient, and that we are currently massively over-using the technology for things it isn't all that useful for.
Good to see so many people misunderstanding how local hosting works.
Running your own local LLM is no worse than running a graphically intensive game like cyberpunk 2077 or red dead redemption 2.
thats what i was thinking
Yes. But compared to the number of people who currently use LLMs, not that many have hardware capable of doing that.
This is why the steam deck is $1,000 btw
Whenever I see these, I try them out. Sometimes I can reproduce them, this one I can't. However, I remain extremely skeptical and believe that whenever one of these screenshots goes around, someone at LLM Company hard codes a fix for that specific fuck up. Against how many of these hard fixes does each LLM answer get checked nowadays?!
On the very long list of shitty things about AI is the fact that they are non-deterministic.
I was however able to get this fuckup on first try:
Wow, you're right. I got three different answers over five queries.
Right. Cause they aren’t answering the question. They are just determining the next most likely word.
AI can make mistakes, so double-check responses
I'm sure it's fine. After all, the AI triple-checked its answer!
I just tried this one and got:
There are 2 t's in the word colonialism:
colonialism
They are located at the end of the word: the t and i at the end of the sequence.
They usually include some randomness in the responses which is why they don’t always respond the same way (and sometimes will even often but not always get the answer correct, or visa versa).
I am also trying from a non English speaking country, pretty sure that has an impact as well on behavior.
I tried it, and got similiar shorter answers but not the exact same answer. Sometimes it ends up getting it right at the end after fumbling a lot, and sometimes it just fails completely.
Searching on Google directly sometimes doesn't produce the AI Overview on stuff like these in my experience, but passing the search to Google from DDG with the bang (!g) almost always produces the AI Overview.
edit: I tried it again and it grew the ability of humor:
There are 2 't's in the word colonialism. colt-a-ca-l-i-s-m (just kidding) C-o-l-o-n-i-a-l-i-s-m:
- t = 0 (If you were thinking of colonization, there is still only 1 't' in the word.)
Interestingly, on one of my attempts it used python to count the number of t's and still ended up getting the "verbal" explanation wrong.
This might be worse then just giving the wrong answer....
Here's what I got:
I can't believe Google missed that third 't' the first time around. So sloppy.
It took several tries but I got one that looped. Most of the time it gives the "there are 2" and puts random arrows.
This used to happen on chatgpt with "Is there a seahorse emoji". Here's a video explaining why this happens.
And this shit is "taking people's jobs"
Hahahahahahahahahahahahahahahaha
Is this actually real though?
Just tested with similar results, output was:
There are exactly 2 't's in the word 'colonialism'. C-o-l-o-n-i-a-l-i-s-m Would you like to check the spelling or character count of any other words? Let me know!
Wow, I didn't think it was still that stupid
I don't think this particular genre of stupid will ever be fully fixed in LLMs to be honest, it's fairly structural
"Coloniatism" is my favourite
Interestingly, it would probably do a better job of writing a piece of code to count how many T's there are, and then reading output of that.
Yeah, it's pretty efficient at that. When the strawberry version was around, CGPT wrote some python and executed it after asking it programatically
I'll never tire of LLM aneurysms.
Pictures, Videos, Articles showing just how boring it is to live in a dystopic society, or with signs of a dystopic society.
Rules (Subject to Change)
--Be a Decent Human Being
--Posting news articles: include the source name and exact title from article in your post title
--If a picture is just a screenshot of an article, link the article
--If a video's content isn't clear from title, write a short summary so people know what it's about.
--Posts must have something to do with the topic
--Zero tolerance for Racism/Sexism/Ableism/etc.
--No NSFW content
--Abide by the rules of lemmy.world
