Kimi K3 - Open Weights

Moonshot AI’s has released Kimi K3’s model weights and technical report

TLDR:

• 2.8 trillion parameter MoE model
• 1M-token context window
• Roughtly 1.56TB on Hugging Face
• Their license explictly requires a separate agreement with Moonshot for “Model as a Service” businesses (who make more than 20M US dollars per month)

Reference

• https://x.com/Kimi_Moonshot/status/2081760186235289764