172
Chinese firms ‘distilling’ US AI models to create rival products, warns OpenAI
(www.theguardian.com)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 29 Jan 2025
172 points (100.0% liked)
Leopards Ate My Face
3901 readers
178 users here now
Rules:
- If you don't already have some understanding of what this is, try reading this post. Off-topic posts will be removed.
- Please use a high-quality source to explain why your post fits if you think it might not be common knowledge and isn't explained within the post itself.
- Links to articles should be high-quality sources – for example, not the Daily Mail, the New York Post, Newsweek, etc. For a rough idea, check out this list. If it's marked in red, it probably isn't allowed; if it's yellow, exercise caution.
- The mods are fallible; if you've been banned or had a comment removed, you're encouraged to appeal it.
- For accessibility reasons, an image of text must either have alt text or a transcription in the comments.
- All Lemmy.World Terms of Service apply.
Also feel free to check out !leopardsatemyface@lemm.ee (also active).
Icon credit C. Brück on Wikimedia Commons.
_portrait.jpg){kind=link}
founded 2 years ago
MODERATORS
Chains of distillation is mostly uncharted territory! There aren't a lot of distillations because each one is still very expensive (as in at least tens of thousands of dollars, maybe millions of dollars for big models).
Usually a distillation is used to make a smaller model out of a bigger one.
But the idea of distillations from multiple models is to "add" the knowledge and strengths of each model together. There's no formal selection process, it's just whatever the researchers happen to try. You can read about another example here: https://huggingface.co/arcee-ai/SuperNova-Medius