How to Run Underdog Saluki 27B: 2-Bit Qwen3.8-27B Tool-Calling Guide

Underdog Saluki 27B is a 7.9 GB quantized version of Qwen3.8-27B that maintains tool-calling capabilities at 2-bit precision and outperforms the full 54 GB model on a 120-task benchmark. The tutorial compares Saluki to ISTA-DASLab's GSQ-RCO quantization using llama.cpp, evaluating memory, speed, and task performance.