INT4 LoRA high-quality-tuning vs QLoRA: A user inquired about the discrepancies between INT4 LoRA fantastic-tuning and QLoRA in terms of accuracy and speed. Another member explained that QLoRA with HQQ entails frozen quantized weights, will not use tinnygemm, and makes use of dequantizing along with torch.matmul Tweet from Harshit Tyagi (@ds