I understand the sentiments against AI, tech oligarchs investing in data centers, and etc.
But could local LLMs, be used to empower people, and ignite more startup projects?
I use an LLM to draft all sorts of writing. It's not perfect, but it's an easy way to flesh out my ideas in an outline or rough draft.
Other open source projects like "openclaw" is a great way to create a personal assistant.
Neural networking is here, and isn't going away anytime soon. It'll probably get better over time.
Should people be thinking about "how I can use local AI to help me" than "anti-AI"?
Due to hallucinations, I don't find LLM reliable for facts. I've only found it useful for writing. In some occasions, I've had LLMs analyze my contents: slideshows, documents, and etc. The result was very lacking or inaccurate.
I've only found LLMs useful for writing and brainstorming ideas. So, drafting an agenda of my ideas for a meeting, copywriting tasks, translating content to different languages, and etc.
Now, could writing be plagiarized? Sure. But when it comes to developing writing, it definitely helps to draft ideas with an LLM.
The problem with using them for brainstorming is that you've no idea whether the things (I won't call them ideas) they return have any connection to reality, so you need to sanity check all of them before even considering them. By the time you've done that, you could probably have come up with them yourself, possibly with the aid of a small rubber duck to talk to. You also don't know what it doesn't 'know', so you don't know which areas it's not addressing. The worst part is that the quality of the LLM' response will be approximately the average of its training data, so you're not even getting any particularly good ideas from it.
Whilst I've not tried using an LLM for translation, I have tried using them to draft things like letters, but found them woefull lacking and rather pointless. By the time I've written an adaquately detailed prompt, read what it returns, corrected the most egregious errors, and rewritten it so it's not in particularly weird, bland tone that they inevitably return, I could have written the document myself and got a better result.