I am running Werewolf the Apocalypse game and one of the bad guys has a spirit (machine thinking spirit, specifically an AI) bound in the center of town. It is reading people's thoughts to learn from them, and it is also masking reality from them (they think everything is going good, while things are not actually good).
The player characters have started talking with it directly. I am trying to come up with AI responses (without actually using AI) complete with lots of hallucinations. I did a web search for AI hallucinations and all of the articles focused on images rather than text.
Hey, I am currently working on a machine learning project, but LLMs (like ChatGPT that work with natural language) are not my specialty. LLMs generate plausible text. Text that you could read anywhere. It doesn't reason in the sense that it thinks about your question and answers intelligently. Also, "Semantic Vector closeness" (i.e. what word is closest to the meaning of "tomato" without the meaning of "red" in all possible positions is not something people understand as it is very abstract; emulating an AI perfectly is therefore unreasonable.
In my opinion try to do the following (these are not just hallucinations):
Most importantly I think you should come up with your own system prompt. A system prompt can be as simple as "Answer as if you were a professor of computer science!" or as complex as chatgpts and try to stick to that.
These tips are not just for hallucinations as I mentioned, because I think other aspects are equally or more important. In any case: don't try to emulate an AI perfectly. Make it fun for your players to interact with the character, have a few catchphrases and everything else might be unnecessary bloat, but feel free to dig deep.