A model that can both make pictures and recognize them may still know a concept after an edit removes it from only one task. Concept unlearning means changing a trained model so it no longer produces or recognizes chosen content, while retaining other abilities.
The team introduces UUBench, a that tests both image generation and visual question answering, or answering questions about pictures. They also develop UniForget, which combines model edits for generation and understanding.
UniForget reaches joint forgetting rates of 80.0% and 92.7% on two tested models, outperforming the evaluated alternatives. The results also show a trade-off: removing a concept can harm other capabilities.
