How to run Underdog Saluki 27B, a 2-bit Qwen3.8-27B, for tool calling
A coding guide compares Underdog Saluki 27B, a 2-bit version of Qwen3.8-27B, with ISTA's GSQ-RCO quantisation. It looks at GGUF headers, memory use and tool-calling performance on the BFCL benchmark in standard llama.cpp.