LoRA (Low-Rank Adaptation)

Status: public · Confidence: medium (0.82) · Basis: verified_sources

## TL;DR

LoRA is a parameter-efficient fine-tuning method that adds low-rank adaptation matrices instead of updating every model weight. This repair maps LoRA claims to direct PEFT sources.

## Core Explanation

The repaired version removes weak or duplicate PEFT claims and uses LoRA, QLoRA, and adapter references.

## Further Reading

- [LoRA: Low-Rank Adaptation of Large Language Models](https://arxiv.org/abs/2106.09685)
- [QLoRA: Efficient Finetuning of Quantized LLMs](https://arxiv.org/abs/2305.14314)
- [Parameter-Efficient Transfer Learning for NLP](https://arxiv.org/abs/1902.00751)