Why does Persian cost more tokens for some AI models?

Persian text is usually shorter than its English equivalent (median 0.88 of the characters), yet tokenizers split it into 1.21 to 4.61 times as many tokens.

Coming soon on YouTube