31
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 06 Feb 2024
31 points (100.0% liked)
Technology
61394 readers
3606 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
One of the size classes they mention in the abstract is called "Weaver Pro" so my initial assumption would be that it's not. However, I find that with this sort of thing the most important secret is that something is possible. If Weaver works as advertised we will now know that it's possible fir a 34B model to get better-than-GPT4 performance, which means lots of people will be willing to devote resources to recreating it since they now know those resources won't be wasted.
And if Weaver is meant to be "commercial" I wouldn't be surprised if there's a bunch of censorship baked into it, so the eventual open-source version will have an advantage.