Tencent Hy4 Is HUGE — 770B Parameters & 1M Token Context Open Source AI Model

Description

Tencent just released Hy4-preview, a massive 770B-parameter MoE AI model with a 1M-token context window. In this video, we take a quick look at Hy4’s architecture, capabilities, benchmarks, and how it compares with other powerful open-source AI models. =====================