I was gonna complain "open weight not open source", but this one actually comes with both the training AND data set reconstruction scripts apparently, making this actually open source in a meaningful way
Hopefully we will see more initiatives like this and also step up to frontier models.
What is frontier models?
It's what high end models are called. They are at the technological frontiet.
Still predictive like the 2019 google paper though right?
I don't know that paper and am not an expert in model architecture. But to my understanding they are still predictive. An important improvement beyond adding more parameters was the introduction of MoE (mixture of experts?) architecture. Basically this segregates the models into experts that are only activated when needed.
Yeah that seems reasonable because of their size.
Fun fact, when this was tested when AI just was predictive networks (well, before LLM), humans got beat to how to handle these cut up smaller networks, a bigger all inclusive net always yielded better results.
Next question :are there European huggingface alternatives? I'd like to be able to point opencode or any opensource agent to a European service hosting opensource models.
Not sure about HF alternatives, but there's eurouter that is the eu equivalent of openrouter. You need to declare a custom provider to use it with opencode but it's the standard text completion api.
All about Europe