Shanghai AI Lab Releases Intern-S2-Mobius and 397B MoE Architecture with Memory-Decoupled Attention
The Shanghai AI Laboratory has published the Intern-S2-Mobius family, spearheaded by the 397B MoE preview model and the innovative Intern-MemDec-4B memory-decoupling system.
Memory-Decoupled Attention (MemDec)
Intern-S2 separates working memory from historical associative retrieval. By utilizing a dedicated 4B auxiliary network to compress conversational context into compact memory vectors, the primary 397B MoE focuses solely on active mathematical deduction and theorem proving.
In tandem with InternLumina-U2 multimodal diffusion checkpoints, Intern-S2 sets high-water marks on OlympiadBench mathematics and formal Isabelle theorem proof generation.
Source & Fact Check
This technical dispatch was verified against primary documentation released by Shanghai AI Laboratory.
Read Original Announcement on Shanghai AI Laboratory →Go deeper: related guide
This story makes more sense when you build it. Here is the practical step-by-step guide:
How to Make Money with ChatGPT: 9 proven workflows →Get 1 AI agent blueprint every week
Free newsletter: one practical AI agent or automation you can build and sell, every week. No spam.