Tencent Hunyuan · Hugging Face new models·· 2 days ago78
tencent/Hy4-flash-FP8
tencent/Hy4-flash-FP8
Brief overview
Tencent Mixue has open-sourced Hy4 flash, Hy4 flash-FP8, and the pre-trained base Hy4 flash-base on Hugging Face, ModelScope, and GitCode. The model has a total of 220B parameters (including 64B Engram parameters), activates 12B per token, natively supports text and image input, and has a context window of up to 1M tokens.
Source: Tencent Hunyuan · Hugging Face new models · huggingface.co