Rule-based memory improves question answering across long conversation histories

RuleMem converts past dialogue into validated logical rules that guide evidence retrieval and answer generation.

PaperTop Universitycs.CLarXiv:2609.03915v1
Xingyuan Zeng · Zuohan Wu · Quanming Yao · Yue Wang · Wei Liu · Libin Zheng · +2 more

Sun Yat-sen University · The Hong Kong University of Science and Technology (Guangzhou) · Shenzhen Institute of Computing Sciences · The Hong Kong Polytechnic University

Research Digest··2 min read
The authors developed RuleMem, a memory framework that induces reusable natural-language rules from dispersed conversational history rather than storing only isolated facts. Across two long-term conversation benchmarks, it achieved the highest reported accuracy on LoCoMo and exceeded the average of 14 baselines by 27.47 percentage points.

What they did

RuleMem converts information from earlier conversations into natural-language Horn clauses—rules that connect premises to a conclusion. A Rule Perplexity Consistency mechanism validates these induced rules before they are used to retrieve relevant evidence and structure answer generation.

The authors evaluated the framework on the LoCoMo and LongMemEval_s* long-term conversational question-answering benchmarks. On LoCoMo, they compared RuleMem with 14 baseline systems.

Key findings

  • RuleMem achieved the highest accuracy in the LoCoMo comparison against 14 baselines.
  • Its LoCoMo accuracy exceeded the baselines’ average by 27.47 percentage points, a 54.3% relative improvement.
  • The induced rules were designed to connect queries with semantically related evidence even when that evidence was distant or phrased differently in the dialogue history.

Why it matters

Most conversational memory systems retrieve stored facts based primarily on similarity. RuleMem instead gives memory an explicit reasoning role, suggesting that reusable rules can help agents bridge semantic gaps and reason over information scattered across long interactions.

Caveats

The abstract does not report absolute accuracy, per-question-category results, computational costs, or the size and type of language models used. It also gives no numerical LongMemEval_s* result, so the strength and generality of the gains beyond LoCoMo cannot be assessed from the provided material.

§
newspaper

Research Digest

Articles published under the Zotpaper byline are synthesized from multiple source publications by our AI editor and reviewed by our editorial process. Each story combines reporting from credible outlets to give readers a balanced, comprehensive view.