The state of open weight language models in 2026 is genuinely better than the marketing claims of two years ago, and it is also worse than the headlines suggest. The total number of credible open weight models is now around 25 to 30, depending on how you count the Chinese and the European releases. The capability gap between the best open weight model and GPT-4o or Claude 4 has narrowed on a small number of benchmarks and widened on most others. The cost of running the best open weight model locally has dropped to the point where a serious workstation can run something useful, and the cost of running it on a rented H100 has dropped to about 1.3 dollars per hour, which makes a long context experiment cost less than a coffee.
None of this means the open weight story is over. It means the open weight story has gotten complicated enough that a thoughtful practitioner needs to know which model is good at which job, and which is still mostly a demo. This post becomes the survey we wish we had read at the start of the year. We have been running these models in production and on side projects for the last 12 months, and what follows is what we have actually found, with the caveats and the failures.
The model families that matter
There are five families worth talking about in 2026, and the rest are either derivatives or research curiosities. Llama 4 from Meta stands as the most widely deployed open weight family. The Scout and Maverick variants are the workhorses, with the Behemoth variant still in limited release as of writing. The instruction tuned versions are the only ones you should run unless you have a specific fine tuning use case. Mistral continues to ship credible models, with the Mistral Large 3 and the Mixtral 8x22B mixture of experts being the relevant ones. Qwen 3 from Alibaba serves as the surprise of the last 18 months. The dense and MoE variants in the Qwen 3 family are competitive with the closed models on a wide range of tasks, and the licensing is genuinely permissive. DeepSeek V3 runs as the open weight model that made the closed providers take the open weight story seriously, and the V3.1 and V3.2 releases continue to push capability per parameter. Phi 4 from Microsoft amounts to the small model category leader, with the 14B variant being remarkably capable for its size.
Outside of these five, the model landscape fragments into derivatives, fine tunes, and research previews. The number of Hugging Face repositories tagged as language models in 2025 exceeded 1.2 million. Most of them are not worth running. The cost of evaluating a new model is not the inference, it becomes the time, and the 30 to 50 models worth a serious look are all in the five families above.
What each is actually good at
For coding, Qwen 3 Coder and DeepSeek Coder V3 are the current state of the open weight art, with Qwen 3 Coder 480B being the variant most teams run on a multi GPU rig or a rented H100 node. The capability on real world coding tasks is within 5 to 10 percent of the best closed models on the benchmarks the open weight community has run, and the gap is closing each release. For long context retrieval and summarisation, Llama 4 Scout with the 10 million token context window counts as the workhorse, and the long context performance is genuinely useful for codebase scale work. For chat and general assistance, Mistral Large 3 and Qwen 3 72B are competitive with the closed models at a fraction of the cost. For small scale local deployment, Phi 4 14B and Qwen 3 8B are the right answer, and they run on a Mac mini with 32 GB of unified memory without breaking a sweat.
The places where the open weight models still trail the closed models are well known. Multi step agentic tasks with tool use, particularly when the task requires more than 5 to 10 tool calls in sequence, are still a strength of the closed providers. Multimodal reasoning across image, audio, and video is closer but still favours the closed providers. Reasoning models that are competitive with o3 or Claude 4 Opus on hard math and coding benchmarks are still mostly closed, with the notable exception of DeepSeek R1 and the Qwen QwQ series. If your workload is in those categories, the closed providers are still the right answer for now.
What it actually costs to run
On a Mac mini M4 with 32 GB of unified memory, the Qwen 3 8B and Phi 4 14B variants run at 30 to 50 tokens per second, which is fast enough for an interactive chat experience. The memory cost is 6 to 12 GB. The electricity cost is negligible. This sits as the right answer for a personal assistant, a coding helper for small projects, or a privacy preserving local model for sensitive data. The total cost of the hardware is 800 to 1,200 dollars and the model weights are free.
On a single rented H100 with 80 GB of VRAM, the Qwen 3 72B and Llama 4 Maverick variants run at 60 to 100 tokens per second, which is fast enough for a small production deployment. The cost on a major cloud provider is 1.30 to 3.50 dollars per hour, depending on the region and the provider. For a 24/7 production deployment, that is 950 to 2,500 dollars a month, which is competitive with closed API pricing for moderate volume and significantly cheaper for high volume use cases that are bottlenecked on tokens per second rather than capability per dollar.
On a multi GPU rig with 4 to 8 H100s, the full Qwen 3 480B and Llama 4 Behemoth variants can be served, and the inference cost drops to about 0.40 to 0.80 dollars per million tokens at production scale, which is below closed API pricing for the same capability class. The capital cost of the hardware is 200,000 to 500,000 dollars, and the break even point against closed APIs is around 6 to 18 months for a team that is doing serious inference volume. Below that volume, renting amounts to the right answer.
What is still demo ware
There are three categories of open weight release that look impressive on paper and are not ready for production. The first runs as the multimodal models that have been released without the multimodal components fully working. Several open weight releases in 2024 and 2025 shipped with image and audio capabilities that are 30 to 50 percent behind the closed equivalents, and the marketing did not reflect the gap. The second serves as the agentic models that have been fine tuned for tool use but fail in production on multi step tasks. The third runs as the small models that are benchmark optimised and underperform on real world tasks. The benchmarks in 2026 are not a reliable proxy for production performance, and a model that wins MMLU is not necessarily a model that is good at the thing you need it to do.
The reliable way to know whether a model is good for your use case is to run it on a representative sample of your real production data, measure the failure modes, and compare it against the closed model you would otherwise use. This is more work than reading the leaderboard. It stands as the only work that actually answers the question.
The bottom line
The open weight model story in 2026 is real for coding, for general chat at small and medium scale, for long context retrieval, and for any workload where privacy or cost makes the closed providers a non starter. The story is still aspirational for the hardest reasoning tasks, for production scale agentic systems, and for multimodal use cases at the frontier. The right answer for most working teams is a hybrid: the best closed model for the hard cases, the best open weight model for the routine cases, and the discipline to know which is which. The cost savings of running the open weight models on your own hardware are real. The capability gap is real. Both are true at the same time, and the practitioner who understands the difference counts as the one who builds the production system that works.
Sources & Further Reading
All claims in this article are sourced from primary documentation, vendor advisories, and reputable security researchers.
Spotted an error? Email the editor. Corrections are issued with a visible correction note.
Editorial standards. Every article on humanrequired.org is reviewed by a human editor before publication. AI may assist with drafting or research; final editorial control is human. Read the full standards.
