FIELD NOTES TOPIC
low-rank adaptation
2 notes, newest first.
Statistical Inference for Rank Allocation in Low-Rank Adaptation
In this paper, the authors propose StatLoRA, a statistical inference-based rank allocation method for low-rank adaptation (LoRA) in large language models. The proposed method uses estimated p-values to determine which…
Statistical Inference for Rank Allocation in Low-Rank Adaptation
Researchers propose StatLoRA, a statistical inference-based method for rank allocation in low-rank adaptation (LoRA). This method aims to balance efficiency, expressiveness, and generalization by using estimated…
