3

I’m just a user of the website perchance.org/ai-rpg. I really liked this website, and I’d like to continue my story written in the story generator on it. But to make the continuation comfortable, I have to write down brief excerpts of the important moments of my adventure in the review, because the AI sometimes forgets important moments or important characters. But, as stated on the website itself: a large amount of content in the story review reduces the AI’s short‑term memory. And this became noticeable when the adventure has been going on for quite a while. The AI simply forgets events that happened a few messages ago.I’m not very strong in neural networks or programming, and I have a vague idea of how all of this is structured and how it works. My question is simple. Can I, for example, save a file with a review of the adventure on my PC and have the AI use the data from it without taking up memory on the servers, so that it doesn’t lead to a reduction in available memory? Is it possible to do this somehow? If it is possible, how?

you are viewing a single comment's thread
view the rest of the comments
[-] MindlessMass@lemmy.world 2 points 3 days ago

if you click the edit button in the top-right corner, you can ask the AI helper questions like that and it will examine the code of the generator for you to try and give you answers. I have been using it to update/modify/add features to ai-character-chat and it has been helping a ton. It does get confused sometimes but it has been really helpful for understanding how things work and/or are structured in the code and the way the AI handles some stuff. Here is an answer from the AI helper on perchance.org/ai-rpg: `Short answer: no, not in the way you're imagining — and here's why.

The "memory" that runs out is not server storage. It's the AI's context window: a fixed budget of tokens (roughly "pieces of text") the model can look at on each reply. Anything you want the AI to remember has to be placed inside that window every single time it writes. So a long recap file on your PC would only help the AI if its contents were loaded into the prompt — and the moment they are, they consume exactly the same memory as if the text lived on a server. Relocating the text doesn't free up memory; only shrinking it does.

That's the practical fix, and it's simpler than it sounds. The goal is to spend fewer tokens on your recap, not to store it elsewhere:

Compress, don't collect. Replace the long "review" with a tight bullet-point summary of only what truly matters (named characters, their goals, promises, secrets, unresolved plot threads). Dense facts > prose. The same adventure can usually fit in a quarter of the space.
Periodically summarize the summary. Every so often, ask the generator itself: "Summarize the story so far in 100 words, keeping only the most important facts." Then replace the old recap with that shorter version. This is exactly how the technique works in professional LLM apps — it's called summarization/compression, and it's the legitimate workaround for a finite context window.
Trim history. If the generator feeds the whole chat log into the prompt, the old messages are the real memory-eater. Shortening or removing early messages (after condensing them into your recap) recovers memory far more effectively than any file trick.

So the accurate mental model: your recap isn't "stored memory," it's a payment you make from a fixed token budget on every message. You can't move the budget — but you can spend it much more efficiently.` Good luck

this post was submitted on 04 Aug 2026
3 points (100.0% liked)

Perchance - Create a Random Text Generator

1940 readers
16 users here now

⚄︎ Perchance

This is a Lemmy Community for perchance.org, a platform for sharing and creating random text generators.

Feel free to ask for help, share your generators, and start friendly discussions at your leisure :)

This community is mainly for discussions between those who are building generators. For discussions about using generators, especially the popular AI ones, the community-led Casual Perchance forum is likely a more appropriate venue.

See this post for the Complete Guide to Posting Here on the Community!

Rules

1. Please follow the Lemmy.World instance rules.

2. Be kind and friendly.

  • Please be kind to others on this community (and also in general), and remember that for many people Perchance is their first experience with coding. We have members for whom English is not their first language, so please be take that into account too :)

3. Be thankful to those who try to help you.

  • If you ask a question and someone has made a effort to help you out, please remember to be thankful! Even if they don't manage to help you solve your problem - remember that they're spending time out of their day to try to help a stranger :)

4. Only post about stuff related to perchance.

  • Please only post about perchance related stuff like generators on it, bugs, and the site.

5. Refrain from requesting Prompts for the AI Tools.

  • We would like to ask to refrain from posting here needing help specifically with prompting/achieving certain results with the AI plugins (text-to-image-plugin and ai-text-plugin) e.g. "What is the good prompt for X?", "How to achieve X with Y generator?"
  • See Perchance AI FAQ for FAQ about the AI tools.
  • You can ask for help with prompting at the 'sister' community Casual Perchance, which is for more casual discussions.
  • We will still be helping/answering questions about the plugins as long as it is related to building generators with them.

6. Search through the Community Before Posting.

  • Please Search through the Community Posts here (and on Reddit) before posting to see if what you will post has similar post/already been posted.

founded 3 years ago
MODERATORS