Hacker News ★ 87 4 min

Claude Opus 5.5 Intelligence, Performance and Price Analysis (Max)

🔗 https://artificialanalysis.ai/models/claude-opus-5-5

📌 【第三方跑分】Claude Opus 5.5 智慧奪冠,但代價是更貴、更囉嗦

TL;DR:Artificial Analysis 測出 Claude Opus 5.5 智慧指數全場第一,但成本與輸出量都偏高。

模型排行榜上拿到第一名,聽起來像是無條件的好消息。但 Artificial Analysis 對 Anthropic Claude Opus 5.5(Adaptive Reasoning, Max Effort, Default Fallback)的分析報告揭示了一個更立體的畫面:智慧分數確實遙遙領先,但同一份報告裡,成本與「話多程度」也一起被排到了後段班。

🤔 這份跑分測了什麼

Artificial Analysis Intelligence Index v4.3.2 由十項評測組成:AA-Briefcase v1.1、GDPval-AA v2.1、AutomationBench-AA、Terminal-Bench 4.0、SciCode、Humanity’s Last Exam、GDP.pdf、CritPt、AA-Omniscience、AA-LCR v1.1。Claude Opus 5.5 是推理型模型(reasoning model),支援文字與圖片輸入、僅輸出文字,並具備 1M tokens 的上下文視窗,在同一比較區間(212 個模型)中被拿來排名。

📊 智慧第一,成本與冗長度卻排在後段

在 Artificial Analysis Intelligence Index 上,Claude Opus 5.5 拿下該評測類別中的第 1 名(212 個模型中),指數為 58 分,遠高於同類模型的中位數 25 分。但在成本排名上,它只排第 93 名(212 個模型中),輸入定價每百萬 tokens 4 美元、輸出定價每百萬 tokens 20 美元,兩者都比中位數(分別為 2 美元與 10 美元)明顯偏高;即使套用 95% 的快取折扣,平均每完成一個 Intelligence Index 任務仍要花費 5.98 美元。輸出量方面同樣排在後段(第 95 名/212),評測期間總共生成了 2.6 億個輸出 tokens,遠高於同類模型 8,800 萬個的中位數,代表這個模型在回答同一批任務時明顯比其他模型「話更多」。速度(每秒輸出 tokens)在報告中則標示為未知(N/A)。

💡 智慧、成本、冗長度是同一枚硬幣的三面

把這三組數字放在一起看,會發現它們彼此相關:輸出量偏高,本身就會直接推高輸出端的計費成本,而 5.98 美元的每任務成本,某種程度上正是「高輸出 tokens 數 × 較貴的輸出單價」疊加後的結果。對工程團隊而言,這代表評估一個模型時,不能只看智慧指數的名次,還要把「它會用多少 tokens 才能回答完」一併算進總體擁有成本(TCO)裡,尤其是在 agentic 工作流這種一次任務會反核呼叫模型多次的場景下,冗長度的影響會被放大。

⚠️ 看懂第三方跑分的邊界

這份報告是 Artificial Analysis 依自家 Intelligence Index 方法論做出的橫向比較,聚合了上述十項既有評測,並非針對 Claude Opus 5.5 量身打造的專屬測試;速度欄位標示不明,也提醒讀者不是每個維度都有足夠資料可以下定論。討論串在 Hacker News 上引發了不少關注,但跑分本身反映的是特定評測組合下的表現,實際專案裡的模型選擇,仍應搭配自己的任務型態與 prompt 做驗證。

🎯 給工程團隊的參考

如果你的工作負載對延遲或 token 成本敏感,這份報告提醒你不要只盯著智慧指數排名:Opus 5.5 在原始能力上確實名列前茅,但實際部署前,值得用自己的任務去量測輸出長度與每次呼叫的實際花費,再決定是否值得為這個智慧等級多付這筆代價。

🔗 來源

#Anthropic #ClaudeOpus5 #LLMBenchmark #ArtificialAnalysis #AIBenchmarking #ModelComparison #IntelligenceIndex #LLMPricing #AICost #ReasoningModels

原始資料 Hacker News · 收集於 2026-09-23
來源原標題
Claude Opus 5.5 Intelligence, Performance and Price Analysis (Max)
作者
theanonymousone
原始標籤
hackernews
來源訊號
HN points 326 HN 留言 103
原始連結
https://artificialanalysis.ai/models/claude-opus-5-5

摘要原文

Artificial Analysis K Anthropic • Claude Opus 5.5 max • Proprietary model • Released September 2026 Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) Intelligence, Performance & Price Analysis Compare Try it out API Provider Benchmarks Model summary Intelligence Updated # 1 / 212 58 Artificial Analysis Intelligence Index 4 out of 4 units for Intelligence. Speed N/A Output tokens per second Unknown out of 4 units for Speed. Cost # 93 / 212 In $4.00 Out $20.00 Cache Discount 95% $5.98 Cost per Intelligence Index task 4 out of 4 units for Cost. Verbosity # 95 / 212 260M Output tokens from Intelligence Index 4 out of 4 units for Verbosity. Comparison Summary Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) is amongst the leading models in intelligence, but somewhat expensive when comparing to other models of similar price. The model supports text and image input, outputs text, and has a 1M tokens context window. Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) scores 58 on the Artificial Analysis Intelligence Index, placing it well above average among comparable models (median: 25). When evaluating the Intelligence Index, it generated 260M tokens, which is very verbose in comparison to the median of 88M. Pricing for Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) is $4.00 per 1M input tokens (somewhat expensive, median: $2.00) and $20.00 per 1M output tokens (somewhat expensive, median: $10.00). On average, it costs $5.98 per task to evaluate Claude Opus 5.5 (Adaptive Reasoning, Max Effort, Default Fallback) on the Intelligence Index. Technical specifications Reasoning Yes This page shows the reasoning version of this model. A non-reasoning variant may also exist. Input modality Supports: text and image Output modality Supports: text Context window 1M ~1500 A4 pages of size 12 Arial font 212 models in this class Metrics are compared against models of the same class: Non-reasoning models → compared only with other non-reasoning models Reasoning models → compared across both reasoning and non-reasoning Open weights models → compared only with other open weights models of the same size class: Tiny: ≤4B parameters Small: 4B–40B parameters Medium: 40B–150B parameters Large: >150B parameters Proprietary models → compared across proprietary and open weights models of the same price range, using a blended 3:1 input/output price ratio: <$0.15 per 1M tokens $0.15–$1 per 1M tokens >$1 per 1M tokens Highlights Updated Intelligence Artificial Analysis Intelligence Index · Higher is better Speed Output tokens per second · Higher is better Cost per Task Weighted average cost (USD) per Intelligence Index task · Lower is better Prompt Options Intelligence Updated Artificial Analysis Intelligence Index Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1 28 of 674 models Add model from specific provider Artificial Analysis Intelligence Index Artificial Analysis Intelligence Index v4.3.2 includes: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1 . See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them. Open Weights / Proprietary Reasoning / Non-Reasoning Text Only / Multimodal Inputs Artificial Analysis Intelligence Index by Open Weights / Proprietary Artificial Analysis Intelligence Index v4.3.2 incorporates 10 evaluations: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1 28 of 674 models Add model from specific provider Proprietary Open Weights Open Weights (Commercial Use Restricted) Artificial Analysis Intelligence Index Artificial Analysis Intelligence Index v4.3.2 includes: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1 . See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them. Open Weights Indicates whether the model weights are available. Models are labelled as 'Commercial Use Restricted' if commercial use is limited by conditions, and as 'Non-commercial' if the license prohibits commercial use. Capability Indexes Measures the performance of models on specific capabilities and industries Finance & Accounting Strategy & Ops Legal Engineering Economics Artificial Analysis Finance & Accounting Index Incorporates 7 evaluations: AA-Omniscience, GDPval-AA v2.1, AA-Briefcase v1.1, Humanity's Last Exam, AutomationBench-AA, AA-LCR v1.1, GDP.pdf · Higher is better 28 of 171 models Add model from specific provider Benchmarks Intelligence Evaluations Intelligence evaluations measured independently by Artificial Analysis · Higher is better Coding Agentic Tool Use Private Dataset User Interaction Finance Medical Legal Intelligence Index Long Context Multimodal Instruction Following Faithfulness Writing Business See more 18 of 26 evaluations 28 of 674 models Add model from specific provider AA-Briefcase v1.1 Updated Agentic knowledge work, (Elo-500)/2000 GDPval-AA v2.1 Updated Agentic real-world work tasks, (Elo-500)/2000 AutomationBench-AA Updated Agentic SaaS workflows Terminal-Bench 4.0 New Agentic coding & terminal use SciCode Coding Humanity's Last Exam Reasoning & knowledge GDP.pdf New Professional document reasoning, All-pass CritPt Under review Physics reasoning AA-Omniscience Accuracy Knowledge AA-Omniscience Non-Hallucination Rate 1 - hallucination rate AA-LCR v1.1 Long context reasoning Harvey LAB-AA Legal agentic work, criterion pass rate EnterpriseOps-Gym-AA Agentic business operations AA-AnalystAgent Quantitative analysis on spreadsheets & documents 𝜏³-Banking Agentic tool use ITBench-AA Kubernetes incident root-cause analysis MMMU-Pro Visual reasoning MLCR-AA New Medical long context reasoning Intelligence Evaluation Relevance While model intelligence generally translates across use cases, specific evaluations may be more relevant for certain use cases. Artificial Analysis Intelligence Index Artificial Analysis Intelligence Index v4.3.2 includes: AA-Briefcase v1.1, GDPval-AA v2.1, AutomationBench-AA, Terminal-Bench 4.0, SciCode, Humanity's Last Exam, GDP.pdf, CritPt, AA-Omniscience, AA-LCR v1.1 . See Intelligence Index methodology for further details, including a breakdown of each evaluation and how we run them. AA-Briefcase v1.1 Updated AA-Briefcase Elo AA-Briefcase Rubric Score (%) Analytical Quality & Presentation Elo AA-Briefcase Elo AA-Briefcase v1.1 is an agentic knowledge work benchmark developed by Artificial Analysis. AA-Briefcase Elo is a combined metric that aggregates rubric pass rate, analytical quality Elo and presentation Elo · Higher is better 28 of 192 models Add model from specific provider AA-Briefcase Elo AA-Briefcase Elo is a combined metric that aggregates analytical quality Elo, presentation Elo, and rubric pass rate, with rubric performance converted into Elo via synthetic head-to-head matches. Elo and 95% confidence interval bounds are clamped at 0. AA-Omniscience AA-Omniscience Index AA-Omniscience Accuracy AA-Omniscience Hallucination Rate AA-Omniscience Index AA-Omniscience Index (higher is better) measures knowledge reliability and hallucination. It rewards correct answers, penalizes hallucinations, and has no penalty for refusing to answer. Scores range from -100 to 100, where 0 means as many correct as incorrect answers, and negative scores mean more incorrect than correct. 28 of 549 models Add model from specific provider AA-Omniscience Index AA-Omniscience Index (higher is better) measures knowledge reliability and hallucination. (326 points, 103 comments on Hacker News)

由 claude-code/sonnet 自動生成