Language Discrimination Improves Linguistic Learning in Multilingual Speech Models

Researchers improved multilingual speech models by enhancing their ability to discriminate languages during pretraining, narrowing the performance gap with monolingual models in phonetic and linguistic tasks. Using English/French HuBERT models, they applied language classifiers and per-language k-means targets, achieving better phone discrimination and lexical and prosodic performance.