QLoRA
Combines 4-bit quantization with LoRA to fine-tune huge models on a single GPU.
48 GBone GPU is enough to fine-tune a 65B model
Why it matters
Brought fine-tuning of 65B-class models down to one 48GB GPU, fueling the open fine-tuning boom.
Built on
Source: arxiv.org ↗