Skip to content
Live
Synced·Added· 4 days ago

SUT: Open-sources REMORY, a 1.9B memory module enabling small models to independently work for 3 days producing output not inferior to GPT-6.1-Terra

Brief overview

Shanghi Academy open-sources REMORY, a 1.9B memory module enabling small models to work independently for 3 days, producing output not inferior to GPT-6.1-Terra. It adopts fully self-supervised training, leading in multiple evaluations, and can be driven with two H800 cards.

Source: Synced · jiqizhixin.com