this post was submitted on 30 Dec 2023
151 points (94.7% liked)

Technology

72506 readers
3722 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 

MemoryCache is an experimental developer project to turn a local desktop environment into an on-device AI agent.

all 35 comments
sorted by: hot top controversial new old
[–] Newtra@pawb.social 57 points 2 years ago* (last edited 2 years ago) (2 children)

The website does a bad job explaining what its current state actually is. Here's the GitHub repo's explanation:

Memory Cache is a project that allows you to save a webpage while you're browsing in Firefox as a PDF, and save it to a synchronized folder that can be used in conjunction with privateGPT to augment a local language model.

So it's just a way to get data from browser into privateGPT, which is:

PrivateGPT is a production-ready AI project that allows you to ask questions about your documents using the power of Large Language Models (LLMs), even in scenarios without an Internet connection. The project provides an API offering all the primitives required to build private, context-aware AI applications.

So basically something you can ask questions like "how much butter is needed for that recipe I saw last week?" and "what are the big trends across the news sites I've looked at recently?". But eventually it'll automatically summarize and data mine everything you look at to help you learn/explore.

Neat.

[–] gunpachi@lemmings.world 10 points 2 years ago

They should find a better fitting name than MemoryCache. Thanks for this comment.

[–] douglasg14b@lemmy.world 9 points 2 years ago

Damn, this is EXACTLY the kind of project I've been seeking out and trying to figure out.

I want all my browsing habits stored locally for AI to tell me what I saw, or to find something I read, or to dig up a citation I swear exists.

[–] pastermil@sh.itjust.works 22 points 2 years ago (2 children)

I thought they're trying to reinvent in-memory key-val storage meant for caching.

[–] qaz@lemmy.world 6 points 2 years ago* (last edited 2 years ago) (1 children)

I don't think this name is very fitting, because that was my first thought as well. Something like "Firefox local assistant" would probably be a bit clearer.

[–] pastermil@sh.itjust.works 2 points 2 years ago (2 children)

I think it's gonna be another Pocket -- stuff nobody wants that Mozilla keeps on pushing for no apparent reason.

[–] danthehutt@lemmy.world 3 points 2 years ago

But I like pocket...I save all my recipes in there

[–] syd@lemy.lol 1 points 2 years ago

I agree Pocket part. Pocket is literally an extension. Why they’re installing it built-in and don’t let us remove?

I think they should’ve made it as extension, install it by default and let us remove it.

[–] starman@programming.dev 2 points 2 years ago (1 children)

Looks like Mozilla is inspired by Microsoft's great naming skills

[–] recapitated@lemmy.world 1 points 2 years ago

Let's call everything link, but each product misspelled in a unique way.

[–] AtmaJnana@lemmy.world 19 points 2 years ago (1 children)

Interesting project. Terrible name.

[–] recapitated@lemmy.world 1 points 2 years ago

Instead of saying "I googled it", we can say "I memcached it" 🤔

[–] themurphy@lemmy.world 13 points 2 years ago

This thing sounds mostly like a way to explore the possibilities with AI. Which I'm all for.

It sounds like it will learn from what you do in your browser, and as we are humans and therefore have alot of habits, then we might find this tool useful!

[–] BetaDoggo_@lemmy.world 5 points 2 years ago

We're not breaking ground on AI innovation (in fact, we're using an old, "deprecated" file format from a whole six months ago)

The ggml format isn't "deprecated" it's completely dead. In those 6 months we've also seen 2-4x speedups on some systems, not to mention improved accuracy via kquants. I don't know why they would build out a new extension with such an ancient dependency.

[–] LWD@lemm.ee 3 points 2 years ago* (last edited 1 year ago)
[–] GTG3000@programming.dev 2 points 2 years ago

This seems interesting.

[–] moon@lemmy.cafe 1 points 2 years ago

Why does it have such a generic name that has nothing to do with the project? Also as soon as I see "privacy and terms of conditions" it raised red flags when it's supposed to be on device.

[–] KingThrillgore@lemmy.ml -5 points 2 years ago

I've been holding back my Mozilla funding because they are shirking work on Firefox and Servo