{"id":46,"date":"2026-06-30T23:03:53","date_gmt":"2026-06-30T23:03:53","guid":{"rendered":"https:\/\/deckp.com\/blog\/?p=46"},"modified":"2026-06-30T23:10:34","modified_gmt":"2026-06-30T23:10:34","slug":"local-models-beat-cloud-llm","status":"publish","type":"post","link":"https:\/\/deckp.com\/blog\/2026\/06\/30\/local-models-beat-cloud-llm\/","title":{"rendered":"Can Local Models Beat Cloud LLMs?"},"content":{"rendered":"

Local models<\/strong> running on consumer hardware will never outperform the top cloud models. That’s not going to change. More VRAM, faster interconnects, and training runs that cost millions aren’t going to disappear overnight. If you want the absolute best reasoning or most nuanced analysis, you’re going to pay for it and send it to OpenAI, Anthropic, or whoever leads the curve that week.<\/p>\n

But here’s what gets overlooked: “best” isn’t the same as “good enough”. And for day-to-day tasks, local models<\/strong> might already be good enough. Using local models is becoming more and more popular thanks to rising token costs on one hand and progress in local models on the other.<\/p>\n

Yesterday, when I was looking at another feature request, I got a crazy idea. I wanted to see whether local models<\/strong> could produce useful results using my office workstation has a fairly standard setup: a 16GB Nvidia RTX 5070 Ti and 32GB of RAM<\/strong>. Nothing exotic. It’s the kind of machine a developer or small team most likely already has at their desk.<\/p>\n

How Local Models Compare to Cloud Models<\/h2>\n

I picked a real, small feature request from Deck’s<\/a> backlog \u2014 nothing grand, just a single well-scoped improvement. I pasted the same prompt into two different models and let them write implementation plans, a plain MD file, not code yet.<\/p>\n

First, Claude Opus 4.8<\/strong>. Probably the most popular choice now when you want a serious answer. It produced a solid plan: broken down into phases, with clear steps, edge cases called out, and a reasonable timeline.<\/p>\n

Then I gave it to my local Qwen3.6-35B<\/strong>. Same prompt, same feature request, same constraints. The local models<\/strong> version came back with a plan that was genuinely competitive, or at least long enough to look so. Btw, it came back quickly, kinda the same speed as Claude. Same structure, same level of detail, same attention to edge cases.<\/p>\n

But I didn’t dive too deep into it, and decided to outsource this work to a third AI \ud83d\ude42<\/p>\n

Testing Local Models: The Results<\/h2>\n

To avoid bias, I anonymized both plans and sent them to OpenAI, asking it to evaluate which was better and explain its reasoning:<\/p>\n

\"Plan<\/p>\n

And what came back surprised me:<\/p>\n

”<\/p>\n

Verdict<\/h2>\n

The stronger plan is human-readable-time-entry-input.md<\/code><\/strong> \u2014 the second plan. Since the files do not identify model names, I would say: the model that generated human-readable-time-entry-input.md<\/code> did the best<\/strong>.<\/p>\n

It is more implementation-ready, more technically accurate, and safer for the existing codebase.<\/p>\n

”<\/p>\n

The second plan actually was written by Qwen3.6.<\/strong><\/p>\n

I’m not going to post the whole output here, but I will add only the comparison table to be more reasonable:<\/p>\n

Final score<\/h2>\n
\n
\n\n\n\n\n\n\n\n\n\n\n
Category<\/th>\nFirst plan<\/th>\nSecond plan<\/th>\n<\/tr>\n<\/thead>\n
Scope control<\/td>\n6\/10<\/td>\n9\/10<\/td>\n<\/tr>\n
Technical correctness<\/td>\n4\/10<\/td>\n9\/10<\/td>\n<\/tr>\n
Yup validation approach<\/td>\n3\/10<\/td>\n9\/10<\/td>\n<\/tr>\n
Edge cases<\/td>\n5\/10<\/td>\n8\/10<\/td>\n<\/tr>\n
Implementation readiness<\/td>\n6\/10<\/td>\n9\/10<\/td>\n<\/tr>\n
Verification steps<\/td>\n5\/10<\/td>\n9\/10<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

Winner: second plan \u2014 human-readable-time-entry-input.md<\/code>.<\/strong><\/p>\n

Conclusion<\/h2>\n

Let me be clear: I’m not writing this to declare a winner between models. Qwen vs Claude vs whatever comes next \u2014 it doesn’t matter. What matters is the implication.<\/p>\n

A 35B-parameter local model running on hardware that fits on a desk, with no monthly bill, no API rate limits, and no data leaving your network, can produce output that an evaluator with access to the very best cloud models can’t reliably distinguish from them.<\/p>\n

Here’s the takeaway: you don’t always need the top model. You just need a local model that’s good enough for the job. And the line between “good enough” and “the best available” keeps shifting lower.<\/p>\n

The Qwen3 family<\/a> has been making waves in the open-source community, with models ranging from 0.5B to 110B parameters. The 35B version I tested strikes a balance between capability and accessibility \u2014 it fits on a single consumer GPU while still delivering serious performance.<\/p>\n

Meanwhile, cloud models like Claude Opus from Anthropic and GPT-5.5 from OpenAI continue pushing the frontier. But frontier doesn’t always mean practical. For many day-to-day tasks \u2014 writing implementation plans, summarizing documentation, generating code \u2014 the gap between top-tier cloud models and capable local models is closing fast.<\/p>\n","protected":false},"excerpt":{"rendered":"

Can local models beat cloud LLMs? My 35B Qwen3 model shocked me \u2014 OpenAI’s judge picked it over Claude Opus 4.8. Here’s the full experiment and what it means for your workflow.<\/p>\n","protected":false},"author":1,"featured_media":61,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,31,16],"tags":[32,34,13,33,35],"class_list":["post-46","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-consulting-tools","category-ai","category-productivity","tag-ai","tag-claude","tag-focus-and-productivity","tag-local-models","tag-qwen"],"_links":{"self":[{"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/posts\/46","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/comments?post=46"}],"version-history":[{"count":21,"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/posts\/46\/revisions"}],"predecessor-version":[{"id":70,"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/posts\/46\/revisions\/70"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/media\/61"}],"wp:attachment":[{"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/media?parent=46"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/categories?post=46"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/deckp.com\/blog\/wp-json\/wp\/v2\/tags?post=46"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}