161

MemoryCache is an experimental developer project to turn a local desktop environment into an on-device AI agent.

all 34 comments
sorted by: hot top controversial new old
[-] Newtra@pawb.social 57 points 11 months ago* (last edited 11 months ago)

The website does a bad job explaining what its current state actually is. Here's the GitHub repo's explanation:

Memory Cache is a project that allows you to save a webpage while you're browsing in Firefox as a PDF, and save it to a synchronized folder that can be used in conjunction with privateGPT to augment a local language model.

So it's just a way to get data from browser into privateGPT, which is:

PrivateGPT is a production-ready AI project that allows you to ask questions about your documents using the power of Large Language Models (LLMs), even in scenarios without an Internet connection. The project provides an API offering all the primitives required to build private, context-aware AI applications.

So basically something you can ask questions like "how much butter is needed for that recipe I saw last week?" and "what are the big trends across the news sites I've looked at recently?". But eventually it'll automatically summarize and data mine everything you look at to help you learn/explore.

Neat.

[-] gunpachi@lemmings.world 10 points 11 months ago

They should find a better fitting name than MemoryCache. Thanks for this comment.

[-] pastermil@sh.itjust.works 22 points 11 months ago

I thought they're trying to reinvent in-memory key-val storage meant for caching.

[-] qaz@lemmy.world 6 points 11 months ago* (last edited 11 months ago)

I don't think this name is very fitting, because that was my first thought as well. Something like "Firefox local assistant" would probably be a bit clearer.

[-] pastermil@sh.itjust.works 5 points 11 months ago

I think it's gonna be another Pocket -- stuff nobody wants that Mozilla keeps on pushing for no apparent reason.

[-] danthehutt@lemmy.world 3 points 11 months ago

But I like pocket...I save all my recipes in there

[-] syd@lemy.lol 1 points 11 months ago

I agree Pocket part. Pocket is literally an extension. Why they’re installing it built-in and don’t let us remove?

I think they should’ve made it as extension, install it by default and let us remove it.

[-] starman@programming.dev 2 points 11 months ago

Looks like Mozilla is inspired by Microsoft's great naming skills

[-] recapitated@lemmy.world 1 points 11 months ago

Let's call everything link, but each product misspelled in a unique way.

[-] AtmaJnana@lemmy.world 19 points 11 months ago

Interesting project. Terrible name.

[-] recapitated@lemmy.world 1 points 11 months ago

Instead of saying "I googled it", we can say "I memcached it" 🤔

[-] themurphy@lemmy.world 15 points 11 months ago

This thing sounds mostly like a way to explore the possibilities with AI. Which I'm all for.

It sounds like it will learn from what you do in your browser, and as we are humans and therefore have alot of habits, then we might find this tool useful!

[-] deur@feddit.nl 7 points 11 months ago

what in the actual fuck is this stupid shit and why is mozilla anywhere near it?

[-] fruitycoder@sh.itjust.works 41 points 11 months ago

Open source project focused on giving people features they want but in a privacy and censorship resistant way. Classic Moz

[-] revv 31 points 11 months ago

Seriously, what's with all the Mozilla hate on Lemmy? People bitch about almost everything they do. Sometimes it feels like, because it's non-profit/open-source, people have this idealized vision of a monastery full of impoverished, but zealous, single-minded monks working feverishly and never deviating from a very tiny mission.

Cards on the table, I remain an AI skeptic, but I also recognize that it's not going anywhere anytime soon. I vastly prefer to see folks like Mozilla branching out into the space a little than to have them ignore it entirely and cede the space to corporate interests/advertisers.

[-] Cupcake1972@mander.xyz 2 points 11 months ago

because "oh no Mozilla foundation bad" "they take google money"

[-] LWD@lemm.ee 1 points 11 months ago* (last edited 11 months ago)
[-] vrighter@discuss.tchncs.de 4 points 11 months ago

but it is not a feature i want. not now, not ever. An inbuilt bullshit generator, now with less training and more bullshit is not something I ever asked for.

Training one of these ais requires huge datacenters, insanely huge datasets and millions of dollars in resources. And I'm supposed to believe one will be effectively trained by the pittance of data generated by browsing?

[-] hubobes@sh.itjust.works 5 points 11 months ago

Yes but I like it, so where do we go from here?

[-] Cupcake1972@mander.xyz 4 points 11 months ago

You clearly are wrong and you should feel bad /s

[-] fruitycoder@sh.itjust.works 1 points 11 months ago* (last edited 11 months ago)

Fine tunning is more possible on end user hardware. You also have projects like hive mind and petals that working on distributed training and inference systems to deal with the concentration effects of this you described for base models.

[-] LWD@lemm.ee 1 points 11 months ago* (last edited 11 months ago)
[-] fruitycoder@sh.itjust.works 1 points 11 months ago

That seems more aligned with their mission of fighting misinformation on the web. It looks like fake spot was an acquisition so hopefully efforts like the ones mentioned in this post better help aligne this with their other goals.

[-] LWD@lemm.ee 1 points 11 months ago* (last edited 11 months ago)
[-] fruitycoder@sh.itjust.works 1 points 11 months ago

What I'm saying is Mozzilla, from my understanding, didn't set out to do that but instead aqquired a business that was in order to use their services to fight misinformation. We should pressure them to reform the new part of business to better align with the rest of Mozzilla's goals.

[-] LWD@lemm.ee 2 points 11 months ago* (last edited 11 months ago)
[-] RubberElectrons@lemmy.world 7 points 11 months ago

Dunno, this seems like an interesting idea. What if I've read through a bunch of engineering papers, maybe I could use this as a sort of flashcard to double check my understanding.

[-] LWD@lemm.ee 2 points 11 months ago* (last edited 11 months ago)
[-] BetaDoggo_@lemmy.world 6 points 11 months ago

We're not breaking ground on AI innovation (in fact, we're using an old, "deprecated" file format from a whole six months ago)

The ggml format isn't "deprecated" it's completely dead. In those 6 months we've also seen 2-4x speedups on some systems, not to mention improved accuracy via kquants. I don't know why they would build out a new extension with such an ancient dependency.

[-] KingThrillgore@lemmy.ml 3 points 11 months ago

I've been holding back my Mozilla funding because they are shirking work on Firefox and Servo

[-] LWD@lemm.ee 3 points 11 months ago* (last edited 11 months ago)
[-] GTG3000@programming.dev 2 points 11 months ago

This seems interesting.

this post was submitted on 30 Dec 2023
161 points (100.0% liked)

Technology

60042 readers
2453 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS