| |
Unsloth has released Dynamic v3.0 quantized models (GGUFs) for Qwen 3.8-27B that achieve over 10% better top-1% accuracy compared to competitors at the same model size, using an improved calibration dataset and advanced post-training quantization techniques. The new quantizations are compatible with major inference engines like llama.cpp and Unsloth Desktop, and the company has made their calibration dataset publicly available for community research and development. Unsloth also introduced new evaluation metrics like Divergence-300 @32 tokens to better measure model quality preservation beyond single-token accuracy.
Read Full Article →
← More Tech news