There is a lot of benefit to be had though. It will likely suck at first and I think the tendency for outsourcing this kind of thing is idiotic. The gov needs to be the AI administrator AND the company because AI is extremely privacy invasive and should never be commercialized in any capacity with kids. I don't support even the school having full access to a child's prompting. I say this because I have intimate knowledge of what kind of information can be accessed using this and how invasive it is. I only run my own open source models on my own offline hardware. The only persons within a school with full access to a child's prompting should be someone bound to confidentiality and a Hippocratic oath like a licensed psychiatrist with no obligations or bias towards the school's petty interests.

The education system is largely antiquated presently. I'm all for supporting my community with living wage jobs. Our reductionist culture is a big part of why we are falling apart. When we are presented with efficiency improvements, we are too stupid to adapt, and too stupid to use them as a resource. We flush out that newly created value instead of investing it immediately within ourselves.

The world has changed from an era when a traditional teacher is relevant. Audio visual information is our primary form of communication. With readily available video, it is criminal to continue live lecturing and presentation of static information. There is no chance that the live presentation of information is anywhere near the quality of a polished and edited video. There is very little chance that any given lecturer is truly the best at presenting such information. Such a statement glosses over the fact that there are an enormous range of personalities and functional thought processes. It is extremely unlikely that any given teacher connects well with each individual student. We have had readily available video communication for over a decade. Some university professors readily use the medium and offer class time as more of a workshop or lab environment. Most primary schools lack this kind of adoption of technology, complexity, and efficiency to keep up with the changing world. In truth, we lack the requirement for a teacher to be a life long learner too.

I expect much the same Luddism with AI. With teaching kids, this is pushing AI to the point where it needs serious supervision to be effective. Maintaining a child's autonomy and right to privacy is absolutely critical for the future of society as a whole. However, the ability for AI to adapt to any functional thought and help with individualized problem solving is something that no teacher is capable of with more than one student at a time.

Most of us had to persist through our frustration in order to learn. AI can directly and individually address that frustration and find a solution. It is not always correct, but it is in the same realm of accuracy as an above average teacher. Maybe you too were aware of just how many teachers did not even know the subjects they were tasked with teaching in primary school, I certainly was.