tokeniser
‘Tokeniser tax’: Why AI is more expensive for non-English users
Non-English languages leave less room for documents or conversation history, and require more work to generate an answer.
Non-English languages leave less room for documents or conversation history, and require more work to generate an answer.