código aberto

Tencent Releases Hy4 Preview Open-Source with 770B Parameters and 1M Token Context

Tencent published the Hy4 preview on August 28, a MoE model with 770 billion parameters (49B active) and a 1 million token window, under the Apache 2....