LLM Reference
Concepts & capability filters

model merging

Model merging combines multiple fine-tuned LLMs into a single model by averaging weights, resolving conflicts via task arithmetic or projection methods to preserve capabilities.

Category
Not classified
Difficulty
Not classified
Aliases
None tracked
Last reviewed
2026-07-02

Key facts

  • Techniques like TIES or SLERP mitigate interference, enabling efficient knowledge fusion without retraining.

Models Mentioning model merging(2)