: RNF4 mediates the degradation of the PML-RARα fusion protein.
In the context of computer science and machine learning, refers to 4-bit NormalFloat , a specialized quantization data type introduced in the seminal paper QLoRA: Efficient Finetuning of Quantized LLMs by Tim Dettmers et al. (2023). 📄 Core Concept: The QLoRA Paper NF4.rar
The term "NF4" is central to this "long paper" which revolutionized how large language models (LLMs) are fine-tuned on consumer hardware. : RNF4 mediates the degradation of the PML-RARα
: Compresses 16-bit weights to 4 bits, effectively reducing VRAM usage by ~75% (e.g., a 65B parameter model can be loaded with ~35GB instead of ~130GB). refers to 4-bit NormalFloat