The Communication Bottleneck: A Round-Trip Study of Tree-Structured Expression Serialization in Language Models

Researchers studied how well language models preserve tree-structured expressions when converting them to and from natural language. They found significant loss and asymmetry in communication, with generation errors dominating failures, but fine-tuning improves performance across models.