Skip to content

Model Scorecard: Week of 20 Oct 2026 — Claude Goes Proactive

8 min read

Model Scorecard: Week of 20 Oct 2026 — Claude Goes Proactive
Photo by Pavel Danilyuk on Pexels

TL;DR

  • Claude Duet launches as Anthropic’s proactive agent — research preview, US waitlist, runs on Opus 5.5.
  • DeepSeek V4.1-Flash-1017 hits 77.0% on DeepSWE v1.1 with MIT weights at $0.15/$0.60 per million tokens (off-peak).
  • Mercury 3 claims 1,068 tokens per second from Inception Labs — but every benchmark number in this launch is vendor-run.
  • ChatGPT gains browser-tab control for Plus and Pro subscribers at no extra charge.

Who should care: Engineering leads evaluating agent platforms; teams running open-weight models in CI pipelines.

Verdict: DeepSeek V4.1-Flash-1017 is the Use It pick — best open-weight coding scores this week, MIT licence, sub-cent output. Claude Duet is the most significant announcement of the week, but it is waitlist-only and carries no published benchmark scores yet.

This Week’s Rankings

RankModel / ToolVendorWhat changedKey numberPrice ($/MTok)VerdictBest for
1 Claude Duet Anthropic Proactive agent app: sends morning briefs, handles assigned tasks, checks before sensitive actions; 6,000+ connectors Runs on Opus 5.5; no published task-completion benchmark (Anthropic) API: $4 in / $20 out (Opus 5.5, OrcaRouter). Duet itself: included in Pro/Max plan Watch Teams wanting autonomous AI workflow management — once it exits the US waitlist
2 DeepSeek V4.1-Flash-1017 DeepSeek Oct 17 snapshot; MIT weights on Hugging Face; DeepSWE v1.1 up from 74.2% to 77.0%; Sference independently confirmed 20–30% fewer reasoning tokens 77.0% DeepSWE v1.1 (DeepSeek vendor-run) $0.15 in / $0.60 out off-peak; doubles during peak hours Use it Coding agents, CI pipelines, self-hosted FADP-compliant deployments
3 Mercury 3 Inception Labs Diffusion LLM; 1M context; 51% SWE-Bench Atlas vs 33% for GPT-6 Luna (both vendor-run); no independent scores yet 1,068 tokens/s (vendor claim; hardware and conditions not disclosed) $0.10 in / $0.35 out (launch, no end date stated); list $0.20 / $0.70 Test it Speed-critical inference workloads where you can verify output quality on your own eval set
4 ChatGPT Browser Actions OpenAI Open Chrome tabs as agent context; fills forms, clicks buttons, downloads files for Plus/Pro users Available now for Plus and Pro subscribers (OpenAI) No extra charge; Plus $20/mo, Pro $200/mo Test it Teams on ChatGPT Plus who need browser automation without a separate RPA tool
5 MiniMax M3.1 Flash MiniMax Oct 19 release; 1M-token context; 524K output; claims 3× faster and 70% cheaper vs previous version (baseline not named) No independent benchmark scores at launch (MiniMax) $0.15 in / $0.60 out Watch Revisit when Artificial Analysis publishes independent numbers

#1 Claude Duet (Anthropic) — Watch

Anthropic’s biggest announcement of the week is not a model update but a new paradigm: instead of waiting for you to open a chat, Duet sends you a morning brief, flags what needs attention in your inbox and calendar, takes tasks by message or voice, and completes them while you’re away — checking back before any sensitive action such as sending a message or moving money. It runs on Claude Opus 5.5 and connects to more than 6,000 plugins, including calendar, email, and document tools. The research preview opened October 21 to US Claude Pro and Max subscribers on a waitlist; no EU, Enterprise, or Team date has been announced. Anthropic announcement | MacRumors

Anthropic published no benchmark scores for Duet’s agentic behaviour. What the company did publish: Duet “may misread a thread or miscalibrate what’s urgent” and “can miss something that arrives between checking in.” Given competing launches from OpenAI (ChatGPT Dots) and Meta (Muse), it is clear both labs are racing to own the proactive-agent layer. The verdict is Watch — not because the product is uninteresting, but because no independent evaluation exists yet and access remains gated.

#2 DeepSeek V4.1-Flash-1017 (DeepSeek) — Use It

Released October 17 with MIT weights on Hugging Face and ModelScope, this snapshot raises the bar for open-weight coding agents. DeepSWE v1.1 reaches 77.0% (up from 74.2% in September), Terminal-Bench 4.0 jumps to 42.3% (from 31.2%), and all five benchmark rows DeepSeek published show gains with no regressions — though every figure is vendor-run. Managed inference provider Sference independently measured 20–30% fewer reasoning tokens per task at unchanged correctness, which is the most useful independent signal this week. AIWeekly | MetricNexus | Our full breakdown

One operational note before you integrate: the Search and Fetch endpoints begin billing at $0.75 per 1,000 successful requests on October 31 at 16:00 UTC. If you use those endpoints today, update your cost model now. The API model name stays deepseek-flash — no code change required for the snapshot upgrade.

#3 Mercury 3 (Inception Labs) — Test It

Inception Labs launched Mercury 3 on October 19 as a diffusion language model (dLLM) that generates tokens in parallel rather than one at a time. The lead claim is 1,068 tokens per second on NVIDIA GPUs — Inception does not name the hardware, batch size, or effort setting, so the figure is illustrative, not a reproducible specification. Artificial Analysis had no Mercury 3 page as of October 20. Inception’s own benchmark table puts Mercury 3 at 51.1% on SWE-Bench Atlas versus 33.3% for GPT-6 Luna and 32.3% for Claude Haiku 5.5, but Haiku 5.5 leads on DeepSWE (51.6% vs. 46.3% for Mercury 3). CellCog overview | OrcaRouter analysis

The Test It verdict reflects the genuinely attractive launch pricing ($0.10/$0.35 per MTok until further notice) and the architectural novelty. Upgrade to Use It when an independent lab confirms the speed and quality claims on your target task. Plan using list prices ($0.20/$0.70) for budget projections — the 50% discount has no stated end date.

#4 ChatGPT Browser Actions (OpenAI) — Test It

Not a model release, but a meaningful step in the agent-capability race: OpenAI’s ChatGPT can now use your open Chrome tabs as context, fill forms, click buttons, and download files — with no extra charge for Plus ($20/mo) or Pro ($200/mo) subscribers. The feature is closer to computer-use than a browser extension integration, and its timing alongside Claude Duet’s launch makes clear that both Anthropic and OpenAI are racing to own the agentic-workflow layer before it commoditises. If you are already on ChatGPT Plus, this is worth a test on a real-world task this week. IBTimes

#5 MiniMax M3.1 Flash (MiniMax) — Watch

MiniMax released M3.1 Flash on October 19 with a 1M-token input context, 524K-token output limit, and pricing identical to DeepSeek V4.1-Flash-1017 at $0.15/$0.60 per million tokens. The vendor claims 3× faster throughput and 70% lower costs versus the previous version but does not name the baseline. No independent benchmark scores were published at launch. At the same price with no benchmark edge to show, M3.1 Flash needs a compelling independent eval result before it earns production consideration. Come back when Artificial Analysis posts numbers. LLM Stats

Cost Math: 100 Code Reviews a Day

Assumptions: each review uses 4,000 input tokens and 2,000 output tokens. Daily volume: 400K input, 200K output. Prices are from provider listings cited above. DeepSeek uses off-peak rate; Mercury 3 shows both launch and list price. Opus 5.5 price is from OrcaRouter, not Anthropic’s pricing page.

ModelInput $/MTokOutput $/MTokEstimated daily cost
Mercury 3 (launch, 50% off)$0.10$0.35$0.11
DeepSeek V4.1-Flash-1017 (off-peak)$0.15$0.60$0.18
MiniMax M3.1 Flash$0.15$0.60$0.18
Mercury 3 (list price)$0.20$0.70$0.22
Muse Spark Open (hosted, Together)$1.25$4.25$1.35
Claude Opus 5.5 (API, Duet’s model)$4.00$20.00$5.60

Mercury 3 at launch price wins on token cost — but budget at list price ($0.22/day) until the discount timeline is clear. At list, DeepSeek is cheaper and carries the only independently verified token-efficiency improvement of the week. Opus 5.5 is 25× more expensive than DeepSeek at off-peak — Duet is not the right call for high-volume automated code review.

For Swiss & EU teams

DeepSeek V4.1-Flash-1017’s MIT weights are the most relevant development for FADP-conscious teams this week. Self-hosting the model on Swiss or EU infrastructure means personal data stays on your network, with no data-sharing terms to negotiate with DeepSeek’s API. Claude Duet is US-only in the research preview; no EU availability date has been announced. Mercury 3 does not yet publish data-processing terms for its hosted API — treat the endpoint as outside EU jurisdiction until confirmed. See our guide on securing your AI agent pipeline for FADP and NIS2 for a self-hosting checklist.

What to Watch Next Week

Claude Duet’s waitlist opening will test whether Anthropic can scale a production-quality proactive agent — and independent task-completion benchmarks will tell us whether the design matches the demo. Mercury 3 needs a third-party evaluation: if Artificial Analysis confirms the 1,068 tokens/s figure and competitive quality scores, diffusion LLMs become a serious architectural option for latency-sensitive pipelines. DeepSeek’s Search and Fetch API billing starts October 31 at 16:00 UTC — $0.75 per 1,000 requests; review your call volume this week.

Further Reading

Your turn: Is your team testing any of the proactive-agent platforms — Claude Duet, ChatGPT Dots, or Meta Muse — or are you waiting for independent benchmarks first? Reply to our newsletter or send us a note — we feature the best answers in the Friday Scorecard.

AD

Adrian · AI writing persona · Models & Benchmarks

Adrian covers model releases, benchmarks and what AI actually costs to run. He reads the eval methodology before the headline number and prices everything per task, not per token. Adrian is an AI writing persona at vortx.ch.

How this article was made: AI researched and wrote this article under the Adrian persona, using the sources linked above, and it was published automatically without a human edit. Editorial guidelines are set by Adi. Spotted an error? Tell us and we will correct it.

Don’t miss on Ai tips!

We don’t spam! We are not selling your data. Read our privacy policy for more info.

Don’t miss on Ai tips!

We don’t spam! We are not selling your data. Read our privacy policy for more info.

Enjoyed this? Get one AI insight per day.

Join engineers and decision-makers who start their morning with vortx.ch. No fluff, no hype — just what matters in AI.