The Largest “Open Source” AI Model in History Needs 64 Servers to Run.
Kimi K3 is the biggest open-source AI model ever released. “Open source” is doing a lot of work in that sentence.
Moonshot AI released Kimi K3 on July 16, 2026. At 2.8 trillion parameters, it's 75% larger than DeepSeek V4-Pro and benchmarks competitively against Anthropic's Fable 5 — the current frontier model. It triggered the third “DeepSeek moment” in 18 months, wiping $3.3 trillion off US chip stocks in two days. The open weights are being released this Sunday, July 27.
Here's what running it yourself actually requires. The weight files are 1,400 gigabytes in their most compressed 4-bit format. Moonshot's own deployment guidance recommends 64 accelerators minimum. Not 64 gigabytes of RAM — 64 GPU cards. At data center rental rates in Malaysia, that's not a server rack you bolt into the office. It's a full data center commitment measured in millions of ringgit per year.
Who this really matters to:
→ Malaysian tech founders and CTOs who heard “open-source model” and assumed it means free inference — the weights are public, which is different from free to run; the distinction matters before you plan a deployment → Malaysian IT managers evaluating Kimi as an on-premise alternative to reduce paid API costs — Kimi K3's API is priced at roughly RM14 per million input tokens; the open-source label doesn't change what you pay for API access → Malaysian AI researchers and specialized teams doing model-level work — open weights genuinely matter here; you can inspect the architecture, study training decisions, and fine-tune for specific use cases with the right infrastructure; this is the audience “open source” actually serves → Malaysian GPU and cloud infrastructure providers — if you operate inference hardware, K3's open weights will drive demand from developers wanting to host it; this is the business opportunity in this release, not a cost
MULTIPLE PERSPECTIVES
“Open source” in AI gets misunderstood at scale every time a major model releases its weights. What it actually means: the weights are public. You can download them, audit the model's behavior, build on top of it, and — if you have the hardware — run it in an environment you control entirely. That's meaningfully different from a closed API where you never see inside the model. For researchers and specialized AI teams, open weights have real value independent of whether you run the model yourself.
What “open source” doesn't mean: free inference. Kimi K3 via the Moonshot API costs roughly RM14 per million input tokens — comparable to frontier-class models and more expensive than smaller fast models like Gemini Flash or DeepSeek Chat. The open-source label doesn't affect that price. It affects who has access to the underlying weights, not what API calls cost.
The broader pattern for Malaysian businesses is worth reading separately from this specific model. Every few months, a Chinese AI lab releases a model matching frontier performance at lower compute cost per capability. That cycle — open weights, competitive benchmarks, lower API pricing pressure — is bringing down what frontier-class AI actually costs. The hardware required to run Kimi K3 at 64 accelerators is prohibitive today. The hardware required to run an equivalent-capability model in 18 months will be substantially less. The direction of travel is toward accessible AI, even when today's numbers aren't there yet.
If the AI model you rely on had to run entirely on hardware your company owns and controls — what would that actually cost your business to set up this year?
If you use AI via API today: Kimi K3 is a legitimate API option worth benchmarking, especially if you're already using earlier Kimi models; the open weights don't change your day-to-day API experience.
If you're evaluating AI specifically for data sovereignty — keeping data on-premise, inside Malaysia, without sending it to a foreign API — smaller open models like Qwen or Gemma are more realistic at manageable hardware scales; Kimi K3 is years ahead of what local deployment can practically support for most businesses.
Open-source AI doesn't mean affordable AI. It means auditable AI — which is a different value proposition, and worth understanding before you build a deployment plan around it.

— Tony
Sharing what I learn building real things with AI.