591
Companies Are Throttling Employees’ AI Use Because It’s Too Expensive
(www.404media.co)
This is a most excellent place for technology news and articles.
Yeah pretty much. Tokens are how models parse sentences.
It’s a wonky thing to charge by because each model tokenizes sentences differently. A sentence that would be 10 tokens in Claude can be 15 in OpenAI.
It’s why it’s crazy to try and charge by it and track employee usage by it.