Retrofitted LLM can count the letter ‘i’s in ‘artificial intelligence’

Researchers have developed a method called byteification that enables existing token-based large language models (LLMs) to process text at the byte level, allowing them to accurately count individual letters such as 'i' in words. This retrofit preserves the models' overall performance while granting access to character-level information previously inaccessible due to token encoding.