Recently I used ChatGPT for editing an email and it opened this in place editor where I could highlight a small section, a little box would open, I could tell it what i thought was wrong, and then it would just edit just that section. But I could also just edit the text myself directly. This is way better than having it re-write my whole text, having to figure out where that section went, and copy-pasting it back into my actual text. It felt a lot more like editing with a co-author, not in the "it's like a person way" but in the it's a focused edit way. Idk, it's a better writing experience.
Having played with LibreOffice Extensions a bit before I'm fairly certain at least a primitive version of this could be made, but I was hoping someone might have experience with the existing Extensions. Most of them look like "write a paragraph for me" to my eye, but none have great descriptions either.
Thoughts?
Edit: Alternatively, does anyone have thoughts on the requirements on the model side of things to make this? It's fairly trivial to feed the current text into the LLM and define the highlighted text. I suspect I could figure out how to open a window of some sort to tell it more - actually using comments would make this pretty easy in Libre Office, but I'm not sure if I know how to get the LLM to give me reliably parsable output... I could probably make track changes thing or at the worst a comment by the LLM I just don't know if telling it to only respond with the edit would work... It's been a while since I've played with all this.
Edit 2: Frustratingly the OpenAI interface has changed since I made this post and it's currently trash. that re-writes for you rather than making suggestions. Annoying.
Yes, I mean local HTTP. ollama listens on port 11434 and responds to HTTP requests by default. I'm not sure what llama-server uses by default, but like I said, I'm pretty sure you can do the same (or at least something very similar) with it.
OK, I see what you mean. I'm still too new to LLMs myself to have a good answer then on that beyond saying that I know it works with qwen3.6 and gemma4 from having actually experimented with those specifically.
I mean, something like:
is good enough in practice for the kinds of things I've been doing. (I'm dealing with cases where triple backticks should never appear in the output though; you might have to get more creative if you want a result that has that kind of quoting embedded in something else...)