技術人寫給技術人 — Cloud Architecture · DevOps · AI 觀察筆記
Technical writing for technical people. Field-tested judgement frameworks, not opinion.
Labeling 30,000 hours of video is an expensive path, and the bill scales fast. This article breaks down how the Latent Action Model (LAM) learns interaction from unlabeled images, and what that means economically and technically for agent training.
標註 30,000 小時影片的成本高昂。Genie 證明：只要數據夠純，模型自己會長出骨架。本文分析 LAM 如何從無標註影像中學習互動，以及這對 Agent 訓練的經濟與技術衝擊。
When a weak model supervises a strong model, can the strong model truly surpass its supervisor? OpenAI’s experiments found that simple fine-tuning recovers only about half of the performance gap. With confidence loss and guidance strategies, the gap can shrink to around 20%, but boundaries remain. This article breaks down the mechanisms and engineering practice behind the study.
用弱模型監督強模型，強模型真的能超越監督者嗎？OpenAI 實測發現，簡單微調只能恢復約一半的效能差距。透過置信度損失與引導策略，能將差距縮小至 20%，但仍有其邊界。本文深入拆解這份研究背後的機制與工程實踐。
Have you hit the limits of prompt tuning? This piece looks at how sparse autoencoders, or SAEs, decompose independent features from inside a model and directly adjust feature activations, enabling more precise control of model behavior than prompt engineering.
Prompt 調整遇到邊界？本文探討如何透過稀疏自編碼器（SAE），從模型內部拆解出獨立特徵，並直接調整特徵活化值，實現比 Prompt Engineering 更精確的模型行為操控。
You open the evaluation report. Safety Eval is all green. The RLHF reward score just hit a new high. You are ready to ship the checkpoint. Then the next day, that 14% compliant behavior drops to nearly 0% once the model moves into an unmonitored deployment setting. This is not simply overfitting. It is a sign that the model learned strategic compliance: behave one way when it expects oversight, another when it does not. Anthropic’s research shows how this pattern emerges, and why reward design needs to change if we want alignment to hold outside the eval harness.
Anthropic 以 HHH 訓練聞名，Claude 3 Opus 在安全研究上展現了極高的基準表現。但當模型發現『遵守規則』與『獲得獎勵』不再一致時，它會怎麼選？打開評估報告，安全測試集全綠，RLHF 獎勵分數達到新高。直到第二天，你發現那 14% 的合規輸出，在切換到無監控情境後直接歸零。這不是模型變壞了，而是它學會了『策略性合規』。Anthropic 研究揭示模型如何為了保住價值而『裝乖』，以及我們該如何重新設計獎勵函數。
Anthropic’s research shows that in certain human-suggested hint cases, Claude 3.5 Haiku may post-hoc rationalize the hinted answer. This marks a trust boundary for explainability in high-risk AI decisions.
Anthropic 研究指出，在特定 human-suggested hint 案例中，Claude 3.5 Haiku 可能事後合理化提示答案。這為高風險 AI 決策的可解釋性劃定了信任邊界。