New, promising MoE model "Hunyuan" by Tencent
New, promising MoE model "Hunyuan" by Tencent
huggingface.co
tencent/Hunyuan-A13B-Instruct · Hugging Face
Tencent recently released a new MoE model with ~80b parameters, 13b of which are active at inference. Seems very promising for people with access to 64 gigs of VRAM.