Liquid AI Open-Sources Pipette: A Reproducible Benchmarking Suite That Measures On-Device Models, Quantization, Runtime and Hardware Together

Liquid AI launched Pipette, an open-source benchmarking suite that evaluates foundation models' performance on edge devices by measuring model, quantization, runtime, and hardware together. It includes a dataset covering over 1,000 configurations and supports multiple platforms and devices.