tokenizers v1: encode, decode and scaling, measured

Tokenizers v1 significantly improves performance over v0.23, often by tens of times, addressing tokenization bottlenecks in large-scale machine learning workflows. It maintains compatibility with previous versions while enhancing speed, scalability, and hardware support.