YTGET

YouTube · Facebook · X · TikTok · Instagram · Threads

Kimi K3.1 Pro 六項實測拆解:5.37 分排第六,與 Opus 5.5 的落差在哪

YouTube 影片筆記

Kimi K3.1 Pro 六項實測拆解:5.37 分排第六,與 Opus 5.5 的落差在哪

原片標題:Kimi K3.1 Pro is REALLY BAD!

原片說明
Star PandaCode on GitHub: https://github.com/aicodeking/pandacode Join this channel to get access to perks: https://www.youtube.com/channel/@aicodeking/join In this video, I'll be testing Moonshot's new Kimi K3.1 Pro on all six KingBench 4 tasks, and I'll compare it with Opus 5.5, GPT-6 Astra, Haiku 5.5, DeepSeek V4.1 Flash and the rest of my chart. I ran the whole benchmark through PandaCode, my fully open-source app for coding agents, which is tuned for Kimi Code, with six K3.1 workers running in parallel and a separate evaluator testing every project. We'll go through the emulator, the Docker alternative, the room designer, the keyboard app, Pokémon Red and the Fitbit app one by one, and then look at the final score, what the run actually cost and what the open weights mean. At the end, I'll tell you whether K3.1 Pro is worth using, because the launch blog's "almost Opus" story does not hold up in real projects. -- Key Takeaways: 🚀 Kimi K3.1 Pro is Moonshot's post-trained K3 with a 1M context, a 2–3× faster Highspeed version, and open weights promised by November 4th. 📊 The launch blog claims 65.7% on Terminal-Bench 4.0, right next to Opus 5.5 at 66.4% and well ahead of GPT-6 Astra at 58.2%. 💻 I ran all six KingBench 4 tasks through PandaCode, which is fully open source and has a dedicated Kimi Code integration. 🧠 K3.1 scores 5.37 out of 10, sixth out of eleven, behind Opus, Astra, Sol, Argon and even Haiku 5.5. ✅ It is honest about what it didn't build, it blocked all 20 malicious images in the Docker task, and it speaks the real VIA protocol in the keyboard app. ⚠️ It built only the Game Boy part of the emulator, its Docker alternative has no build or networking, and Pokémon has broken levelling and a save-wiping title screen. 💸 The whole run cost about $31.88, compared with $7.40 for Haiku 5.5 and under $2 for DeepSeek V4.1 Flash. 🔍 Most of that bill is 110 million cached tokens that it re-reads on every step, not the code it writes. 🎯 Once the weights land, it will be the best-scoring open-weight model on my chart, ahead of DeepSeek Flash and GLM. 👍 Verdict: a good open model, not a frontier one, and on the API Haiku or DeepSeek Flash are the smarter picks for now.

Moonshot 的發表文說 Kimi K3.1 Pro 幾乎跟 Opus 5.5 平起平坐,我本來還想說開源模型終於追上來了,結果 AICodeKing 跑完六項測試只給 5.37 分,排第六,連 Haiku 5.5 都輸。這支影片就是把這個「幾乎 Opus」的故事拆開來看,一項一項對照它到底做到什麼、沒做到什麼。

開場先公佈總分 5.37
開場先公佈總分 5.3701:04

影片時間軸

  1. 00:01介紹 K3.1 Pro 規格、1M 上下文與 11 月 4 日開源承諾
  2. 01:04先公佈總分 5.37,排在中段班
  3. 01:31說明整輪測試都跑在 PandaCode 上,六個 worker 平行執行
  4. 03:24模擬器只做了 Game Boy,DS 和 3DS 直接不實作
  5. 04:29Docker 替代品 CRUN 擋下 20 個惡意映像,但沒有 build 和網路功能
  6. 05:40房間設計器是最高分項目,7.4 分
  7. 06:32鍵盤 app 意外聽得懂真的 VIA 協定
  8. 07:32寶可夢紅版能走完全程,但升級完全失控
  9. 08:28Fitbit 桌面 app 只接舊 API,貼 token 才能連
  10. 09:13統整排名與成本,結論是不建議按 token 付費使用
房間設計器是這次最高分
房間設計器是這次最高分05:40

發表文與實測的落差

Moonshot 說 Terminal Bench 4.0 拿 65.7%,跟 Opus 5.5 的 66.4% 只差一點,還贏 GPT-6 Astra 七分。但 AICodeKing 自己的榜上,Astra 是 5.65,K3.1 Pro 是 5.37,方向完全相反。幻覺率從 23.4% 降到 8.3% 這件事倒是有兌現,模擬器那段它老實說 DS 和 3DS 沒做,而不是假裝能跑。

CRUN 擋下所有惡意映像
CRUN 擋下所有惡意映像04:29

誠實但只做三分之一的模擬器

Game Boy 核心其實不差,11 項 CPU 指令測試全過,畫面渲染像素級正確,跑起來是 40 倍速。但常見的中斷模式有 bug,會弄壞堆疊,自製遊戲在開頭畫面就掛掉。而且崩潰時存檔不會寫入,進度直接消失。三個系統只交一個,1.8 分很合理。

鍵盤 app 意外聽得懂 VIA 協定
鍵盤 app 意外聽得懂 VIA 協定06:32

安全做得漂亮,功能卻沒收尾

CRUN 用純標準庫寫,拉 Alpine、NGINX、Redis 都對,20 個帶路徑穿越和惡意連結的映像全擋下來,這點贏過榜上不少模型。可是它還稱不上 Docker 替代品:沒有 build、沒有 exec、沒有網路,連效率比較的數據都沒有,只是寫在 readme 裡的主張。

Fitbit app 只能貼 token 連線
Fitbit app 只能貼 token 連線08:28

鍵盤與寶可夢:能動,但離完成很遠

鍵盤 app 是這次的驚喜,講的是真的 VIA 協定,封包大小、命令 ID、巨集編碼都對,拔掉鍵盤還會進 demo 模式。但 11 鍵被畫成 14 鍵,巨集打一個非英文字元整個 app 就空白。寶可夢紅版能從家走到 Brock 不當機,可是每棟建築都是同一種紅屋頂,升級失控到第一道館前就 34 級,標題畫面還預設停在 New Game,按一下就蓋掉存檔。

值得下載嗎

如果你是要判斷該不該用,這支值得看,它把「幾乎 Opus」的行銷話術拆得很清楚。但如果你只是想找模型評測結論,記住一句就好:按 token 付費不划算,有 Kimi 訂閱再考慮。

覺得這篇筆記有幫助嗎?
YTGet 編輯室|看完影片整理的筆記,細節以原片為準。

連線中

影片封面

擷取畫面

輸入時間點,例如 3:20、3.20 或 200

影片皆已含音訊。檔案越大準備時間越久,完成前請保持頁面開啟。