I've been toying with this idea for a while and made a few attempts following tutorials with some very basic coding skills, but honestly I find a lot of the resources and information quite overwhelming to take in sometimes so thought I would ask you guys with more experience here instead!

I have ADHD and often find myself juggling many creative tasks from writing music, writing fiction, graphic design, etc all the time. I find the "load" of all of these different spinning plates in my brain to be a lot to hold onto at times and have found the benefits in using ChatGPT for simplifying things or even just working through my own thought processes, and wanted to take this further.

To my knowledge, Chatgpt has a limited memory/recall ability, and after particularly lengthy conversations, it is unable to recall information from the beginning and starts guessing. Certainly with GPT 3.5 anyway. I also have never been too comfortable sharing much in terms of my creative projects with GPT for privacy reasons.

I have been trying to figure out if a localised model such as GPT4all or OLlama would be able to function better for my needs.

As an example, one of my largest projects is a fantasy fiction novel where I have spent so much time worldbuilding that my notes are quite extensive, and the connections between aspects can be difficult for me to keep track of and can sometimes result in me writing contradictions and having to spend time fixing my own errors. I do have StableDiffusion on my PC that I use to generate artwork to help me visualise people/the world (not intended for publication, obviously, I'd hire a real artist for that) and a fair bit of experience with it.

With GPT4all, or an equivalent, would it be possible for me to train a model on all of my notes and information, saved in a separate document, that I can discuss/collaborate with the model, keeping everything private, offline, and without having the model "forget" things?

Apologies if this is a really basic question that I have turned into a wall of text. But any insight you guys might have, or structured resources you can point me towards would be brilliant.