ChatGPT is leaking passwords from private conversations of its users, Ars reader says : technology

[-] Chozo@kbin.social 219 points 10 months ago

If you paste plaintext passwords into ChatGPT, the problem is not ChatGPT; the problem is you.

[-] R00bot 77 points 10 months ago

Well tbf chatGPT also shouldn't remember and then leak those passwords lol.

[-] Ganbat@lemmyonline.com 61 points 10 months ago

Did you read the article? It didn't. Someone received someone else's chat history appended to one of their own chats. No prompting, just appeared overnight.

[-] narc0tic_bird@lemm.ee 46 points 10 months ago

Well, that's even worse.

[-] wildginger@lemmy.myserv.one 33 points 10 months ago

........ That shouldnt be happening, regardless of chat content

[-] Ganbat@lemmyonline.com 8 points 10 months ago

Well, yeah, but the point is, ChatGPT didn't "remember and then leak" anything, the web service exposed people's chat history.

load more comments (1 replies)

[-] topinambour_rex@lemmy.world 15 points 10 months ago

How ? How it should be implemented? It's just a llm. It has no true intelligence.

[-] Feathercrown@lemmy.world 7 points 10 months ago

If it's not trained on user data it cannot leak it

load more comments (2 replies)

[-] psud@lemmy.world 28 points 10 months ago

Hey chatGPT, is hunter2 a good password?

load more comments (2 replies)

load more comments (3 replies)

[-] lowleveldata@programming.dev 141 points 10 months ago

ChatGPT doesn't leak passwords. Chat history is leaking which one of those happens to contain a plain text password. What's up with the current trend of saying AI did this and that while the AI really didn't?

[-] echodot@feddit.uk 34 points 10 months ago

People are far too willing to believe AI can do anything. How would the AI even have the passwords.

[-] kusivittula@sopuli.xyz 29 points 10 months ago

gots to get dem clicks

[-] Ganbat@lemmyonline.com 21 points 10 months ago

Fear mongering. Remember all the people raging and freaking out about Disney's "AI generated background actors"? Just plain bad CG.

load more comments (2 replies)

[-] Nommer@sh.itjust.works 10 points 10 months ago

FUD for clicks

[-] beefbot 8 points 10 months ago

AT headlines aren’t usually so click bait-ey, but capitalism grows like weeds. Every last news article, we’ve GOT to all ask, who does this serve? Who paid for this irresponsible headline to be run? Whose income is it meant to harm?

Every newsroom boss, like every judge, needs to pay for healthcare (at best, or at worst, or whatever will give them access to some billionaire’s climate survival bunker.) This IS late stage surveillance capitalism. Every decision now is based on that.

load more comments (1 replies)

[-] dhork@lemmy.world 117 points 10 months ago

That's funny, all I see is ********

[-] Xyphius@lemmy.ca 62 points 10 months ago

you can go hunter2 my hunter2-ing hunter2.

haha, does that look funny to you?

[-] whodatdair@lemm.ee 34 points 10 months ago

I put on my robe and wizard hat.

[-] tdawg@lemmy.world 41 points 10 months ago

Back in the RuneScape days people would do dumb password scams. My buddy was introducing me to the game. We were sitting in his parents garage and he was playing and showing me his high lvl guy. Anyway, he walks around the trading area and someone says something like “omg you can’t type your password backwards *****”. In total disbelief he tries it out. Instantly freaks out, logs out to reset his password, and fails due to to the password already being changed

[-] andrew_bidlaw@sh.itjust.works 8 points 10 months ago

That's golden. With all my hatred towards scammers, there's a little niche for scams that make people feel smart before undressing them that I can't bring myself to judge.

load more comments (2 replies)

load more comments (1 replies)

[-] webghost0101@sopuli.xyz 109 points 10 months ago

So what actually happened seems to be this.

a user was exposed to another users conversation.

thats a big ooof and really shouldn’t happen

the conversations that where exposed contained sensitive userinformation

unresponsible user error, everyone and their mom should know better by now

[-] ZzyzxRoad@sh.itjust.works 14 points 10 months ago

Why is it that whenever a corporation loses or otherwise leaks sensitive user data that was their responsibility to keep private, all of Lemmy comes out to comment about how it's the users who are idiots?

Except it's never just about that. Every comment has to make it known that they would never allow that to happen to them because they're super smart. It's honestly one of the most self-righteous, tone deaf takes I see on here.

[-] summerof69@lemm.ee 10 points 10 months ago

I don't support calling people idiots, but here's that: we can't control whether corporations leak our data or not, but we can control whether we share our password with ChatGPT or not.

[-] pearsaltchocolatebar@discuss.online 8 points 10 months ago

Because that's what the last several reported "breaches" have been. There's been a lot of accounts that were compromised by an unrelated breach, but the users re-used the passwords for multiple accounts.

In this case, ChatGPT clearly tells you not to give it any sensitive information, so giving it sensitive information is on the user.

load more comments (6 replies)

load more comments (1 replies)

[-] Ganbat@lemmyonline.com 47 points 10 months ago* (last edited 10 months ago)

They weren't there when I used ChatGPT just last night (I'm a pretty heavy user). No queries were made—they just appeared in my history, and most certainly aren't from me (and I don't think they're from the same user either).

This sounds more like a huge fuckup with the site, not the AI itself.

Edit: A depressing amount of people commenting here obviously didn't read the article...

[-] trk@aussie.zone 14 points 10 months ago

Edit: A depressing amount of people commenting here obviously didn't read the article...

Every time

load more comments (2 replies)

[-] hiramfromthechi@lemmy.world 40 points 10 months ago

It also literally says to not input sensitive data...

This is one of the first things I flagged regarding LLMs, and later on they added the warning. But if people don't care and are still gonna feed the machine everything regardless, then that's a human problem.

[-] NaoPb@eviltoast.org 10 points 10 months ago

Hello can you help me, my password is such and such and I can't seem to login.

[-] MystikIncarnate@lemmy.ca 11 points 10 months ago

People literally do this though. I work in IT and people have literally said, out loud, with people around that can hear what we're saying clearly, this exact thing.

I'm like.... I don't want your password. I never want your password. I barely know what my password is. I use a password manager.

IT should never need your password. Your boss and work shouldn't need it. I can log in as you without it most of the time. I don't, because I couldn't give any less of a fuck what the hell you're doing, but I can if I need to....

If your IT person knows what they're doing, most of the time for routine stuff, you shouldn't really see them working, things just get fixed.

Gah.

load more comments (2 replies)

[-] stoly@lemmy.world 39 points 10 months ago

LOL people are teaching ChatGPT their passwords? Why?

load more comments (2 replies)

[-] AlternatePersonMan@lemmy.world 39 points 10 months ago

And Google is bringing AI to private text messages. It will read all of your previous messages. On iOS? Better hope nothing important was said to anyone with an Android phone (not that I trust Apple either).

The implications are terrifying. Nudes, private conversations, passwords, identifying information like your home address, etc. There's a lot of scary scenarios. I also predict that Bard becomes closet racist real fast.

We need strict data privacy laws with teeth. Otherwise corporations will just keep rolling out poorly tested, unsecured, software without a second thought.

AI can do some cool stuff, but the leaks, misinformation, fraud, etc., scare the shit out of me. With a Congress aged ~60 years old on average, I'm not counting on them to regulate or even understand any of this.

load more comments (1 replies)

[-] philo@lemmy.zip 33 points 10 months ago* (last edited 9 months ago)

[removed by mod]

[-] cm0002@lemmy.world 40 points 10 months ago

You could just watch what you input into it lol ChatGPT is a pretty good tool to have in the toolkit and like any tool there's warnings and cautions on its use.

[-] tsonfeir@lemm.ee 14 points 10 months ago

It’s an amazing tool. I think it’s funny how many people fight it tooth and nail. I like to think they’re the kind of person who refused to use spell check, or the touch tone phone.

[-] gravitas_deficiency@sh.itjust.works 39 points 10 months ago

There are very valid philosophical and ethical reasons not to use it. We’re not just being luddites for the hell of it. In many cases, we’re engineers and scientists with interest, experience, or expertise in neural nets and LLMs ourselves, and we don’t like how fast and loose (in a lot of really, really important ways) all these big companies are playing it with the training datasets, nor how they’re actively disregarding any sort of legal or ethical responsibility around the technology writ large.

[-] tsonfeir@lemm.ee 7 points 10 months ago

Likewise. The same could be said about every technology.

load more comments (1 replies)

[-] Ilovethebomb@lemm.ee 8 points 10 months ago

I'm not against chat GPT or other AI, but I am thoroughly sick of hearing about it.

load more comments (1 replies)

[-] MakingWork@lemmy.ca 7 points 10 months ago

Are there any trustworthy AI apps or alternatives?

[-] Marmanvii@lemmy.one 8 points 10 months ago

HuggingFace Chat does the work for me

load more comments (3 replies)

load more comments (1 replies)

[-] EmergMemeHologram@startrek.website 24 points 10 months ago

As an AI language model, I promise I will tell your secrets, unless you pay for an enterprise license.

[-] realharo@lemm.ee 23 points 10 months ago

Not directly related, but you can disable chat history per-device in ChatGPT settings - that will also stop OpenAI from training on your inputs, at least that's what they say.

[-] beeng@discuss.tchncs.de 20 points 10 months ago* (last edited 10 months ago)

How does it get the password to begin with?

Shit in, shit out!

[-] NedRyerson@lemmy.ml 15 points 10 months ago

Who knew everyone had the same password as me? I always thought I was the only 'hunter2' out there!

load more comments (2 replies)

[-] LainTrain@lemmy.dbzer0.com 14 points 10 months ago

Use local and open source models if you care about privacy.

[-] baseless_discourse@mander.xyz 8 points 10 months ago

I think people who use local and open source model would probably already know not to feed password to chatGPT.

load more comments (4 replies)

[-] randon31415@lemmy.world 12 points 10 months ago

12345? That is what an idiot would use for the password to his luggage!

load more comments (1 replies)

[-] Fades@lemmy.world 12 points 10 months ago

Why the fuck would you give any AI your password???? People are so goddamn stupid

load more comments (2 replies)

Technology

Our Rules

Approved Bots