There is a better explanation for the behavior you are experiencing, and yes, it is one if not the biggest hurdle the new model has yet to overcome: You have hit a log long enough that the model is starting to make a word salad of its past inputs as it "inbreeds".
What I mean by this is something explained before: For generators such as AI Chat and ACC, the input will be mostly 70% AI made and only 30% handwritten (95%-5% in AI RPG which crashes faster), because the whole log is an input for the next output. Of course, the shortest the log is, the less you'll feel the effect of the model being insufferable because you still have the long instruction block "holding back" the manic behavior.
I agree, this is something that has to be worked on from the development side, otherwise generators such as AI Chat or Story Generator are rendered short-lived as the point of them is to grow progressively, and as today, instability can happen as soon as 150kB-200kB, being significantly lower that what this model was able to hold in the past. However, a temporary fix on our side of things is to just make a "partition" of your log/story. Meaning:
- Plan and start your run as usual.
- Save constantly, monitoring the size of the log.
- When you hit the 100kB mark, try to get to a point where you can "start over" as a point where you can keep moving without requiring the context prior.
- Make a copy, delete all prior to that desired state, load the save and continue pretending that nothing happened.
That will keep the model "fresh" at the cost of losing "memory", which can be worked around as you can update the bios or instructions which will have better chances of working now under a clean slate.
It is not the best way to work around this, but it is better than wrestling with all the nonsense that the model will produce past the 250kB threshold.
Hope that helps and... also hole that a future update would make the model more stable rather than more unstable. At least something that was fixed and that the dev deserves more credit for making it work, is that at least now the English has improved significantly compared with the first release. In terms of grammar, content and consistency. I know, past the 250kB it is "allegories" or "crazy man ramblings", but... it is good English! ๐