69

The venture capitalist and new Trump administration member David Sacks, meanwhile, said that there is “substantial evidence” that DeepSeek “distilled the knowledge out of OpenAI’s models.”

“There’s a technique in AI called distillation, which you’re going to hear a lot about, and it’s when one model learns from another model, effectively what happens is that the student model asks the parent model a lot of questions, just like a human would learn, but AIs can do this asking millions of questions, and they can essentially mimic the reasoning process they learn from the parent model and they can kind of suck the knowledge of the parent model,” Sacks told Fox News. “There’s substantial evidence that what DeepSeek did here is they distilled the knowledge out of OpenAI’s models and I don’t think OpenAI is very happy about this.”

This sounds like horse shit to me but I don't know the technical details well enough to say with confidence.

also "suck the knowledge out of the parent model" what the actual fuck?

you are viewing a single comment's thread
view the rest of the comments
[-] BigMuffin69@awful.systems 7 points 19 hours ago

Footage of Deepseek slurping the knowledge out of the GPT4

this post was submitted on 29 Jan 2025
69 points (100.0% liked)

NotAwfulTech

395 readers
3 users here now

a community for posting cool tech news you don’t want to sneer at

non-awfulness of tech is not required or else we wouldn’t have any posts

founded 2 years ago
MODERATORS