6
Any news about the release of the new AI Chat?
(lemmy.world)
Thanks! I can't wait. Just imagine going from 4k tokens to 128k tokens. This is gonna revolutionize free chatbots.
Oh, that's great. So I was right. I'm not crazy, then. Is a new version coming out? I heard they were gonna update it in July, but it never happened.
No way this is llama 3: https://perchance.org/ai-chat Unless there are other "official" chatbots. This chat has a very short memory. I'm sure it is Llama 2; it would make sense, since I suspect it has around 4k token context, while Llama 3 has 128k. Maybe I am missing something. Are there other chats like this that use more advanced LLMs?
Well, I hope it's 3.3, after two years of waiting, and with the image generators using Chroma and Flux. I can't complain about a free service anyway. It will be a bittersweet victory; having 2x context will surely improve the roleplay experience, but it will still be impossible to create lore and world-building unless we have at least 50-60k context tokens. And yes, the actual model is amazing, but it's being held down by the context window; you cannot create a deep lore or word building, and worse of all, the chat forgets the key events around 3-4 pages of convo, having to rely on summaries that miss A LOT of important elements.