Synced·Added· 4 days ago
SUT: Open-sources REMORY, a 1.9B memory module enabling small models to independently work for 3 days producing output not inferior to GPT-6.1-Terra
Brief overview
Shanghi Academy open-sources REMORY, a 1.9B memory module enabling small models to work independently for 3 days, producing output not inferior to GPT-6.1-Terra. It adopts fully self-supervised training, leading in multiple evaluations, and can be driven with two H800 cards.
Source: Synced · jiqizhixin.com