216
submitted 2 months ago by cyrano@lemmy.dbzer0.com to c/usa@midwest.social
you are viewing a single comment's thread
view the rest of the comments
[-] pupbiru@aussie.zone 1 points 2 months ago

you can actually run the model, but it just goes very slowly… i run the 70b model on my m1 mbp, and it technically “requires” 128gb or VRAM - it still runs, just not super fast (though i’d say it’s useable in this case a about 1 word per ~300ms)

this post was submitted on 02 Feb 2025
216 points (100.0% liked)

United States | News & Politics

2807 readers
1410 users here now

Welcome to !usa@midwest.social, where you can share and converse about the different things happening all over/about the United States.

If you’re interested in participating, please subscribe.

Rules

Be respectful and civil. No racism/bigotry/hateful speech.

Post anything related to the United States.

founded 2 years ago
MODERATORS