The authors represented a bank of LoRA adapters as stacked factors connected by a learned coupling matrix.
Read-only LoRA coupling preserves old skills while adding new ones
READ canonicalizes independently trained adapters, then lets each new adapter use prior representations without modifying their established interactions.
Top University
Shanghai Jiao Tong University · Xi’an Jiaotong University · The Hong Kong University of Science and Technology (Guangzhou) · Jinan University
Research Digest··2 min read
Li and colleagues introduce Read-only Expansion of Adapter Deltas, or READ, for incrementally combining LoRA task adapters into one model.
Why this paper
From Shanghai Jiao Tong University and 3 others
In one line
Composing LoRA adapters by allowing new skills to read from old ones but never write to them prevents interference and improves multi-task model performance.
What we could check
- ·No code link found
- ·No weights link found
- ·No dataset link found
- ·No compute details found
- ·No stated limitations found
- ✓Reports numbers on named benchmarks (3 benchmarks)
Observed from the paper text and links we have. Absence here means we did not find it, not that it does not exist.
§