The paper introduces READ (Read-only Expansion of Adapter Deltas), a method for combining multiple independently trained LoRA adapters into a single model. READ canonicalizes adapter factors into a balanced form and uses a coupling matrix that lets a new skill read from old skills but never write into them. Only the new skill's row in the coupling matrix is trained, preserving all existing skills. The composed update folds into the base weights with no extra inference cost.
Evaluated on four benchmarks (GLUE, SuperGLUE, Domain, BBH) with Llama-3.2-3B and Qwen3-4B, READ outperformed the strongest foldable alternatives, e.g., 0.783 vs 0.605 on SuperGLUE and 0.887 vs 0.846 on Domain for Llama-3.2-3B. Across 32 lineages, READ won 24 and lost eight, all on BBH. The key insight is that managing factor coordinates and coupling direction—hidden when adapters are used alone—is critical for successful composition.