Compressing Streaming Neural Audio Encoders via Latent-Space Distillation

Apple researchers developed a method to compress streaming neural audio encoders used in on-device dictation by distilling latent-space representations, achieving 2.8× compression with minimal accuracy loss and improved performance over independently trained models.