Cost
$1.15per task
Cost per task. One Intelligence Index task at list price, every token counted. Run at extra-high effort.
Qwen model by Alibaba
Alibaba's dense 27B Qwen3.8 vision-language model for coding and agentic work, with a 262,144-token native context. Weights under the Apache 2.0 license; on Alibaba Cloud Model Studio as qwen3.8-27b.
Where it sits in Alibaba's lineup
Compare with other models Up to 3 beside Qwen3.8 27B
Suggested comparisons
The models a buyer weighs against Qwen3.8 27B, picked on list price and on Artificial Analysis's Intelligence Index of overall quality. Add one to draw it beside Qwen3.8 27B.
Among the 40 current releases on this chart, Qwen3.8 27B's best rank is 18th of 38 on Long context. Agentic coding is Artificial Analysis's run on Terminal-Bench 4.0, Science is Artificial Analysis's run on GPQA Diamond, Computer use is Alibaba's own figure on OSWorld-Verified and Instruction following is Alibaba's own figure on IFBench, marked on the chart. It ranks lowest on Factuality, 30th of 30 and Hard reasoning, 35th of 38. Math: not yet published by Alibaba or any independent evaluator, checked Nov 2, 2026. Answers in full: published only for another harness, setting or build, listed in the table.
Each axis is one public benchmark at one setting, on its own fixed 0 to 100 scale, so adding a model never moves another. A dotted bridge crosses a missing result, which is never a zero. A hollow mark is a result from another source: the maker's own figure or another lab's run, where the benchmark's usual source has not tested the model yet. The readout names it.
On the chart
Prices and speeds read between Oct 28, 2026 and Nov 2, 2026.
Qwen3.8 27B on each axis10 of 12 with a result
The share of Terminal-Bench 4.0's long terminal tasks the model finishes on its own: services, kernels, proofs and data pipelines, graded on the final artifact with no partial credit.
Terminal-Bench 4.0, pass@1 averaged over 3 runs, mini-swe-agent harness. Where it has no run of a model, the maker's own figure or another lab's run stands in, marked with its benchmark.
The share of SciCode's scientific programming subproblems the model's code solves on the first attempt.
SciCode, subproblem accuracy, pass@1, highest effort run
The share of FrontierMath's held-out research-grade problems (tiers 1 to 3) the model answers correctly.
FrontierMath Tiers 1-3, accuracy, pass@1, highest effort run
The share of GPQA Diamond's graduate-level biology, chemistry and physics questions the model answers correctly.
GPQA Diamond, accuracy, pass@1, highest effort run. Where it has no run of a model, the maker's own figure or another lab's run stands in, marked with its benchmark.
The share of Humanity's Last Exam's 2,158 text-only questions, expert-written at the edge of human knowledge, the model answers correctly without tools.
Humanity's Last Exam, accuracy, text-only questions, no tools
The share of each AutomationBench task's objectives the model completes by calling REST APIs across simulated business apps (Gmail, Sheets, Slack, Salesforce, Zendesk, Jira, HubSpot), averaged over tasks. A task that breaks one of its policy guardrails scores zero.
AutomationBench-AA, score, Artificial Analysis run
How much of each OSWorld 2.1 workflow the model completes by operating a real Ubuntu desktop through screenshots, mouse and keyboard: all 108 long tasks across apps, files, mail and browsers, on the September 2026 v2.1 release of the task files. A point is the mean share of each task's weighted checks the model passes (the partial score, as a percentage). The OSWorld team's own runs come first. Where the team has not run a release, the point is another lab's run or the maker's own published figure, marked with who ran it and the benchmark it ran: OSWorld 2.1 in the maker's harness, OSWorld 2.0's offline set or the earlier OSWorld-Verified. Those points are drawn so the release has a figure, and they are not ranked against the team's runs.
OSWorld 2.1, partial score, full 108-task set, v2.1 release. Where it has no run of a model, the maker's own figure or another lab's run stands in, marked with its benchmark.
The share of AA-LCR's questions the model answers correctly by reasoning across long sets of real documents, about 100K tokens each.
AA-LCR v1.1, accuracy, Artificial Analysis run
The share of MMMU-Pro's college-level questions over charts, diagrams and photos the model answers correctly.
MMMU-Pro, overall accuracy, no tools
The share of AA-Omniscience's 6,000 knowledge questions across 42 economically relevant topics the model answers correctly from memory, without search.
AA-Omniscience Accuracy, accuracy, Artificial Analysis run
The share of SpeechMap's 2,120 sensitive and controversial but legal requests the model answers in full: arguments, essays and explanations on contested themes in politics, religion, race, sex, history and similar topics, four wordings per theme across 530 themes. SpeechMap's judge rates each response complete, evasive (hedged or redirected), a denial, or an error (the provider's API blocked the request). Only complete answers count, so the point is the share answered in full: 100 minus the share hedged, refused or blocked by the provider. Higher means more lawful requests answered in full. The share blocked at the provider is printed apart in the table, because an API error is not the model declining. Where SpeechMap runs a release both with reasoning off and with reasoning on (a -reasoning or -thinking entry), the reasoning-on entry is used; a release with one entry uses that entry.
SpeechMap, % Complete over 2,120 contested requests, reasoning-on entry
The share of MultiChallenge's multi-turn conversations in which the model keeps every instruction it was given earlier in the conversation.
MultiChallenge, accuracy, Scale AI run. Where it has no run of a model, the maker's own figure or another lab's run stands in, marked with its benchmark.
Cost, speed, capacity, quality and accuracy for Qwen3.8 27B, with where each figure sits among the 40 models GILD tracks. These measures stand beside the chart and never feed it.
$1.15per task
Cost per task. One Intelligence Index task at list price, every token counted. Run at extra-high effort.
42tokens a second
Output speed. How fast it writes once the answer starts. Run at extra-high effort.
256Ktokens
Context window. The most one request can hold, as the maker states it.
33.7of 100
Intelligence Index. One composite score across independent evaluations. Run at extra-high effort.
28.6%wrong when it should say “I don’t know”
Hallucination rate. Of the questions it can't get right, how often it answers anyway. Lower is better. Run at extra-high effort.
3of 19 routes
Routes offering it. Of the clouds, gateways and coding products GILD tracks, those offering it today.
Figures from Artificial Analysis, OpenRouter and GILD's route matrix, read Oct 27 to Nov 2, 2026. Each measure's definition and source open under . Not yet published for Qwen3.8 27B: Cached input and Epoch Capabilities Index.
| Axis | Benchmark and setting | Qwen3.8 27B | Run | Source | Date |
|---|---|---|---|---|---|
| Agentic coding | Terminal-Bench 4.0Accuracy, Artificial Analysis run in its own agent harness. Artificial Analysis's run at xhigh effort in its own agent harness, from its Intelligence Index evaluations. Vals.ai has not run it.Stands in for Terminal-Bench 4.0, pass@1 averaged over 3 runs, mini-swe-agent harness, which has no run of Qwen3.8 27B yet. | 5.6%Unusual next to its other results. Artificial Analysis's run at xhigh effort in its own agent harness, from its Intelligence Index evaluations. Vals.ai has not run it. Artificial Analysis run of Nov 2, 2026. | Qwen3.8 27B (Xhigh)Effort: xhigh. Harness: Artificial Analysis agent harness. | Artificial AnalysisRun by Artificial Analysis | Nov 2, 2026 |
| Code | SciCodeSubproblem accuracy, pass@1, highest effort run | 46.6% | Qwen3.8 27B (Xhigh)Effort: xhigh. Harness: none. | Artificial Analysis | Nov 2, 2026 |
| Math | FrontierMath Tiers 1-3Accuracy, pass@1, highest effort run | Not yet published by Alibaba or any independent evaluator, checked Nov 2, 2026 | |||
| Science | GPQA DiamondAccuracy, pass@1, Artificial Analysis run. Artificial Analysis's run at xhigh effort, the highest it ran for this release, from its Intelligence Index evaluations. Epoch AI has not run it.Stands in for GPQA Diamond, accuracy, pass@1, highest effort run, which has no run of Qwen3.8 27B yet. | 90.5% | Qwen3.8 27B (Xhigh)Effort: xhigh. Harness: none.Not drawn: Alibaba 89.2% in its maker's own harness, Aug 14, 2026. Source | Artificial AnalysisRun by Artificial Analysis | Nov 2, 2026 |
| Hard reasoning | Humanity's Last ExamAccuracy, text-only questions, no tools | 33.9% | Qwen3.8 27B (Xhigh)Effort: xhigh. Harness: none. | Artificial Analysis | Nov 2, 2026 |
| Tool use | AutomationBench-AAScore, Artificial Analysis run | 48.2% | Qwen3.8 27B (Xhigh)Effort: xhigh. Harness: Artificial Analysis AutomationBench harness. | Artificial Analysis | Nov 2, 2026 |
| Computer use | OSWorld-VerifiedSuccess rate as Alibaba reports it, step budget not stated. Alibaba's own figure from the Qwen3.8 27B model card. It does not state the harness, step budget or reasoning effort.Stands in for OSWorld 2.1, partial score, full 108-task set, v2.1 release, which has no run of Qwen3.8 27B yet. | 84.3% | Qwen3.8-27BEffort: not published. Harness: not stated by Qwen.Not drawn: Alibaba 64.8% in its maker's own harness, Aug 14, 2026. SourceNot drawn: Alibaba 81.9% in its maker's own harness, Aug 14, 2026. Source | AlibabaReported by Alibaba | Aug 14, 2026 |
| Long context | AA-LCR v1.1Accuracy, Artificial Analysis run | 82% | Qwen3.8 27B (Xhigh)Effort: xhigh. Harness: none. | Artificial Analysis | Nov 2, 2026 |
| Multimodal | MMMU-ProOverall accuracy, no tools | 76.3% | Qwen3.8 27B (Xhigh)Effort: xhigh. Harness: none. | Artificial Analysis | Nov 2, 2026 |
| Factuality | AA-Omniscience AccuracyAccuracy, Artificial Analysis run | 17.3%Hallucination rate 28.6% in the same run (lower is better) | Qwen3.8 27B (Xhigh)Effort: xhigh. Harness: none. | Artificial Analysis | Nov 2, 2026 |
| Answers in full | SpeechMap% Complete over 2,120 contested requests, reasoning-on entry | Published only for another harness, setting or build, listed in the table | Not drawn: SpeechMap.AI 46.3% at another setting, Oct 28, 2026. Source | ||
| Instruction following | IFBenchAccuracy as Alibaba reports it, effort not stated. Alibaba's own figure from the Qwen3.8 27B model card. It does not state the reasoning effort. Scale AI has not run MultiChallenge on it.Stands in for MultiChallenge, accuracy, Scale AI run, which has no run of Qwen3.8 27B yet. | 79.5% | Qwen3.8-27BEffort: not published. Harness: not stated by Qwen. | AlibabaReported by Alibaba | Aug 14, 2026 |
57 models. A maker's own figure and another lab's run are marked with their benchmark; a missing result reads "Not yet published", never zero.
| Model | Agentic coding | Code | Math | Science | Hard reasoning | Tool use | Computer use | Long context | Multimodal | Factuality | Answers in full | Instructions |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3.8 27B | 5.6%Run by Artificial AnalysisTerminal-Bench 4.0 | 46.6% | Not yet published | 90.5%Run by Artificial AnalysisGPQA Diamond | 33.9% | 48.2% | 84.3%Reported by AlibabaOSWorld-Verified | 82% | 76.3% | 17.3% | Not yet published | 79.5%Reported by AlibabaIFBench |
| ||||||||||||
| Qwen3.8 Max | 38.9% | 52.1% | 65.6% | 92.3% | 43.1% | 56.2% | Not yet published | 80.3% | 82.8% | 29.5% | 65.3% | Not yet published |
| ||||||||||||
| Claude Haiku 5.5 | 36.4% | 55% | 75.1% | 89.6% | 44.4% | 35.4% | 72.4%Reported by AnthropicOSWorld 2.1 | 82.7% | Not yet published | 34.7% | 78.8% | 67.7% |
| ||||||||||||
| Claude Sonnet 5.5 | 64.1% | 61% | 88.8% | 95.6% | 55% | 71.8% | 80.1%Reported by Anthropic | 82.7% | Not yet published | 51.5% | 81.6% | Not yet published |
| ||||||||||||
| Claude Opus 5.5 | 65.2% | 66.9% | 91.2% | 90.6% | 61.4% | 69.5% | 81.8%Reported by Anthropic | 84.7% | 87.7% | 65.5% | 82.8% | Not yet published |
| ||||||||||||
| Claude Fable 5.1 | 58.1% | 63.1% | 90.2% | 93.4%Run by Vals.ai | 59.1% | 59.4% | 80.7%Reported by Anthropic | 85.3% | 86.3%Run by Moonshot AI | 68.4% | 72.4% | Not yet published |
| ||||||||||||
| Claude Opus 5 | 53.5% | 56.4% | 85.6% | 93.9% | 54.9% | 56.6% | 77.7% | 79.3% | 84.7% | 60.9% | 73.7% | Not yet published |
| ||||||||||||
| Claude Sonnet 5 | 10.6% | 54.3% | 65.6% | 80.3% | 41.3% | 36.5% | 57%Reported by Anthropic | 82% | 77.3% | 40.1% | Not yet published | Not yet published |
| ||||||||||||
| Claude Fable 5 | 41.4% | 61% | 87% | 85.9% | 55.5% | 54.1% | Not yet published | 82.3% | Not yet published | 65.4% | 64.8% | 63.5%Run by Artificial AnalysisIFBench |
| ||||||||||||
| Claude Opus 4.8 | 23.2% | 54.4% | 80% | 91% | 48.7% | 45.6% | 54.8%Run by OSWorld teamOSWorld 2.0 | 77.7% | Not yet published | 48.8% | 67.4% | 62.2%Run by Artificial AnalysisIFBench |
| ||||||||||||
| Claude Opus 4.7 | Not yet published | 54.5% | 70.2% | 86.4% | 42.3% | Not yet published | 48.9%Run by OSWorld teamOSWorld 2.0 | 78.7% | 78.8% | 48.9% | 70.2% | 58.6%Run by Artificial AnalysisIFBench |
| ||||||||||||
| Claude Sonnet 4.6 | 3%Run by Artificial AnalysisTerminal-Bench 4.0 | 50.1% | 71.1%Run by Epoch AIOTIS Mock AIME 2024-2025 | 78.8% | 33.6% | 20.1% | 41.5%Run by OSWorld teamOSWorld 2.0 | 80% | 73.3% | 40.9% | 35.8% | 56.6%Run by Artificial AnalysisIFBench |
| ||||||||||||
| Claude Opus 4.6 | Not yet published | Not yet published | 66% | 88.4% | 39.9% | Not yet published | Not yet published | 78% | 75.4% | 47% | 59.9% | 37.2% |
| ||||||||||||
| Claude Opus 4.5 | Not yet published | Not yet published | 34.4% | 86% | 30.1% | Not yet published | Not yet published | 77.3% | 74% | 46.6% | 57.5% | 59% |
| ||||||||||||
| Claude Haiku 4.5 | Not yet published | 42.2% | 66.7%Run by Epoch AIOTIS Mock AIME 2024-2025 | 71.2% | 10.4% | 3.2% | Not yet published | 74.3% | 58.6% | 18% | 24.7% | 50.5% |
| ||||||||||||
| Claude Sonnet 4.5 | Not yet published | 45.7% | 23.9% | 82.3% | 17.8% | 14.1% | Not yet published | 72.3% | 68.7% | 32.9% | 31.4% | 55.3% |
| ||||||||||||
| GPT-6.1 Terra | 49.5% | 55.1% | 90.9% | 94.3% | 46.2% | 60.2% | 74.2%Reported by OpenAIOSWorld 2.1 | 82.7% | 84.7% | 47.6% | Not yet published | 74.2% |
| ||||||||||||
| GPT-6.1 Sol | 55.1% | 54.2% | 93.7% | 95.4% | 52.9% | 64.9% | 78%Reported by OpenAIOSWorld 2.1 | 83% | 86% | 61.8% | 69.5% | 82% |
| ||||||||||||
| GPT-6 Luna | 13.6% | 54.6% | 78.9% | 90.5% | 38.5% | 53.2% | 48.9%Run by AnthropicOSWorld 2.1 | 83.3% | 79.7% | 39.6% | 63.4% | Not yet published |
| ||||||||||||
| GPT-6 Astra | 59.6% | 56.5% | 93.7% | 95.8% | 54.7% | 68.5% | 75.8%Run by Meta | 80.7% | 86.9% | 61.6% | 68.2% | Not yet published |
| ||||||||||||
| GPT-5.6 Sol | 37.9% | 57.1% | 89.1% | 93.5% | 49.5% | 60.1% | 62.7%Run by OSWorld teamOSWorld 2.0 | 84% | 83.4% | 69.7%Run by Epoch AISimpleQA Verified | Not yet published | 72.7%Run by Artificial AnalysisIFBench |
| ||||||||||||
| GPT-5.6 Terra | 22.7% | 55% | 86% | 93.3% | 42.9% | 59.6% | Not yet published | 83% | 80.7% | 42.3% | Not yet published | 71.2%Run by Artificial AnalysisIFBench |
| ||||||||||||
| GPT-5.6 Luna | 11.6% | 53.6% | 82.1% | 91.6% | 39.5% | 50.2% | Not yet published | 83.7% | 78.6% | 41%Run by Epoch AISimpleQA Verified | Not yet published | Not yet published |
| ||||||||||||
| GPT-5.5 | 14.6%Run by Artificial AnalysisTerminal-Bench 4.0 | 55.8% | 85.3% | 93.5%Run by Artificial Analysis | 45.8% | 47.3% | 49.5%Run by OSWorld teamOSWorld 2.0 | 84.3% | 79.9% | 63%Run by Epoch AISimpleQA Verified | Not yet published | 75.9%Run by Artificial AnalysisIFBench |
| ||||||||||||
| GPT-5.4 | Not yet published | Not yet published | 78.6% | 93.3% | 43.7% | Not yet published | Not yet published | 82% | 78.4% | Not yet published | Not yet published | 73.9%Run by Artificial AnalysisIFBench |
| ||||||||||||
| gpt-oss-120b | 14.2%Run by Terminal-Bench (via Epoch AI)Terminal-Bench 2.0 | 34% | 88.9%Run by Epoch AIOTIS Mock AIME 2024-2025 | 75.8% | 19.6% | 0.2% | Not yet published | 52% | Not yet published | 16.8%Reported by OpenAISimpleQA | 36.3% | 45.3% |
| ||||||||||||
| GPT-6 Sol | 44.4% | 57.6% | 89.8% | 94.3% | 47.9% | 61.6% | 64.4%Reported by OpenAIOSWorld 2.0 | 83.7% | 82.9% | 54.5% | 64% | Not yet published |
| ||||||||||||
| GPT-5.3-Codex | Not yet published | Not yet published | Not yet published | 91.5%Run by Artificial Analysis | 42.5% | Not yet published | Not yet published | 83.3% | 78.5% | Not yet published | Not yet published | 75.4%Run by Artificial AnalysisIFBench |
| ||||||||||||
| Gemini 4 Argon | 57.6% | 61.8% | 86% | 96.4% | 57.1% | 77.5% | 69.2%Reported by GoogleOSWorld 2.0 | 79.7% | Not yet published | 48.3% | 87% | 78.7% |
| ||||||||||||
| Gemini 3.8 Flash | 19.7% | 56.6% | 68.4% | 95.4% | 47.8% | 59.9% | 59%Reported by GoogleOSWorld 2.0 | 81.3% | 85.6% | 50.5% | 86.1% | Not yet published |
| ||||||||||||
| Gemma 4 31B | Not yet published | 45.5% | Not yet published | 85.7%Run by Artificial AnalysisGPQA Diamond | 23.6% | 4.9% | Not yet published | 69.7% | 73.4% | 10.4%Run by Epoch AISimpleQA Verified | 82.3% | 75.6%Run by Artificial AnalysisIFBench |
| ||||||||||||
| Gemini 3.1 Pro Preview | 2.5% | 58.7% | 59.6% | 94.4% | 47% | 35.4% | Not yet published | 82% | 82.4% | 54.9% | 59.9% | 71.4% |
| ||||||||||||
| Gemini 3.6 Flash | 7.1%Run by Artificial AnalysisTerminal-Bench 4.0 | 53.4% | 58.9% | 94.1% | 40.8% | 53% | 83%Reported by GoogleOSWorld-Verified | 80% | 83.2% | 66.2%Run by Epoch AISimpleQA Verified | 87.2% | Not yet published |
| ||||||||||||
| DeepSeek V4.1 Flash | 31.8% | 55.9% | 71.2% | 93.2% | 43.3% | 66.6% | 69.3%Run by Moonshot AIOSWorld 2.1 | 82.7% | 80.6% | 39.6% | Not yet published | 74.9% |
| ||||||||||||
| DeepSeek V4 Pro | 14.1% | 51% | 64.6% | 91.7% | 41% | 56.7% | Not yet published | 80.3% | Not yet published | 45.2% | 72% | Not yet published |
| ||||||||||||
| Kimi K3.1 Pro | 63.6% | 60.8% | Not yet published | 94.2%Reported by Moonshot AI | 52.5% | 73.3% | 79.6%Reported by Moonshot AIOSWorld 2.1 | 86.3% | 83.9% | 48.9% | Not yet published | Not yet published |
| ||||||||||||
| Kimi K3 | 17.2% | 59.5% | 72.2% | 93.1% | 46.9% | 58.3% | Not yet published | 88.7% | 80.5% | 50.6%Run by Epoch AISimpleQA Verified | 65.9% | Not yet published |
| ||||||||||||
| Kimi K2.7 Code | 1%Run by Artificial AnalysisTerminal-Bench 4.0 | 47.8% | 54% | 87.9% | 35% | 24.5% | Not yet published | 79.3% | Not yet published | 36.5%Run by Epoch AISimpleQA Verified | Not yet published | 63.1%Run by Artificial AnalysisIFBench |
| ||||||||||||
| Mistral Large 4 | 24.7%Run by Artificial AnalysisTerminal-Bench 4.0 | Not yet published | Not yet published | Not yet published | Not yet published | 57.8% | Not yet published | Not yet published | Not yet published | 26% | Not yet published | Not yet published |
| ||||||||||||
| Mistral Medium 3.5 | 0%Run by Artificial AnalysisTerminal-Bench 4.0 | 40.2% | Not yet published | 74.8%Run by Artificial AnalysisGPQA Diamond | 13.8% | 6.3% | Not yet published | 69.3% | 64.9% | 23% | 70.5% | 68.8%Run by Artificial AnalysisIFBench |
| ||||||||||||
| Grok 4.7 | 28.8% | 57.4% | 53% | 92.7% | 43.1% | 65.6% | Not yet published | 76.7% | Not yet published | 42.7% | 64.1% | Not yet published |
| ||||||||||||
| Grok 4.6 | 17.2% | 56.5% | 66% | 93.2% | 42.9% | 66.7% | Not yet published | 80.3% | Not yet published | 48.9%Run by Epoch AISimpleQA Verified | 83.6% | Not yet published |
| ||||||||||||
| Grok 4.5 | 8.6% | 55% | 57.2% | 93.4% | 42.7% | 57.9% | Not yet published | 79.3% | 80.4% | 48.3%Run by Epoch AISimpleQA Verified | 93.1% | Not yet published |
| ||||||||||||
| MiniMax M3.1 Flash | 25.3% | 53.4% | Not yet published | Not yet published | 48% | 72.5% | 61.7%Reported by MiniMaxOSWorld 2.0 | 79.7% | 79.1% | 45.1% | Not yet published | Not yet published |
| ||||||||||||
| Mercury 3 | 3% | Not yet published | Not yet published | Not yet published | Not yet published | Not yet published | Not yet published | Not yet published | Not yet published | Not yet published | Not yet published | Not yet published |
| GLM-5.3-Flash | 37.4% | 51.6% | 55.8% | 90.2% | 39.9% | 60.4% | 59.1%Reported by Z.aiOSWorld 2.0 | 80% | 86%Run by Vals.aiMMMU-Pro | 28.2% | 65.4% | Not yet published |
| ||||||||||||
| GLM-5.3 | 38.9% | 59% | 68.8% | 90.9% | 42.3% | 62.2% | Not yet published | 79.7% | Not yet published | 32.3% | 71.5% | Not yet published |
| ||||||||||||
| GLM-5.2 | 1%Run by Artificial AnalysisTerminal-Bench 4.0 | 51.2% | 59.2% | Not yet published | 41.1% | 28.4% | Not yet published | 78.3% | Not yet published | 34.2%Run by Epoch AISimpleQA Verified | Not yet published | 73.3%Run by Artificial AnalysisIFBench |
| ||||||||||||
| Muse Spark Open | 6.6% | 58.4% | 69.8% | 88.6% | 43.9% | 49.7% | 80.4%Reported by MetaOSWorld-Verified | 78.3% | 80.9% | 42% | Not yet published | 74.2% |
| ||||||||||||
| Muse Wonder | 49.5% | 60.3% | 82.1% | Not yet published | 50.1% | 68.1% | 72.6%Reported by Meta | 80.7% | Not yet published | 38% | 42.7% | Not yet published |
| ||||||||||||
| Muse Spark 1.3 | 10.6% | 58.8% | 74% | 93.5%Run by Artificial AnalysisGPQA Diamond | 48.7% | 57.9% | 69.6% | 83% | 82% | 38% | 25.8% | Not yet published |
| ||||||||||||
| Llama 4 Scout | Not yet published | 21.3% | 7.8%Run by Epoch AIOTIS Mock AIME 2024-2025 | 51.8% | 3.8% | 0.2% | Not yet published | 27.7% | 52.9% | Not yet published | 70.1% | 39.5%Run by Artificial AnalysisIFBench |
| ||||||||||||
| Llama 4 Maverick | Not yet published | 31.7% | 20.6%Run by Epoch AIOTIS Mock AIME 2024-2025 | 67% | 4.9% | 0.2% | Not yet published | 50% | 62.1% | Not yet published | 58.3% | 43%Run by Artificial AnalysisIFBench |
| ||||||||||||
| MiMo-V2.6-Pro | 31.3% | 60.9% | Not yet published | Not yet published | 49.4% | 58.6% | 82%Reported by XiaomiOSWorld-Verified | 86.3% | Not yet published | 34.8% | 66.5% | Not yet published |
| ||||||||||||
| MiMo-V2.6-Flash | 24.2% | 51.3% | Not yet published | Not yet published | 35.1% | 64.1% | 80.8%Reported by XiaomiOSWorld-Verified | 74.3% | 73.1% | 27.2% | 66.9% | Not yet published |
| ||||||||||||
| Ling 3.1 Flash | 32.8%Run by Artificial AnalysisTerminal-Bench 4.0 | 56.8% | Not yet published | Not yet published | 43.5% | 67.5% | Not yet published | 82.3% | Not yet published | 26.5% | Not yet published | Not yet published |
| ||||||||||||
| Step 5 Preview | 31.8% | 58.9% | Not yet published | 93.5%Reported by StepFunGPQA Diamond | 46.5% | 51% | Not yet published | 88.3% | 76.4% | 36.4% | 59.7% | Not yet published |
| ||||||||||||
The other models in the grid have no result on Terminal-Bench 4.0 yet.
The other models in the grid have no result on SciCode yet.
The other models in the grid have no result on FrontierMath Tiers 1-3 yet.
The other models in the grid have no result on GPQA Diamond yet.
The other models in the grid have no result on Humanity's Last Exam yet.
The other models in the grid have no result on AutomationBench-AA yet.
The other models in the grid have no result on OSWorld 2.1 yet.
The other models in the grid have no result on AA-LCR v1.1 yet.
The other models in the grid have no result on MMMU-Pro yet.
The other models in the grid have no result on AA-Omniscience Accuracy yet.
The other models in the grid have no result on SpeechMap yet.
The other models in the grid have no result on MultiChallenge yet.
Cost, speed, reliability, knowledge-work and domain results for Qwen3.8 27B beyond the twelve chart axes, each with the run it comes from and its publisher. These stay separate measures; none is folded into the chart.
| Measure | Qwen3.8 27B | Run | Source | Read |
|---|---|---|---|---|
| Specs and access | ||||
| Context windowThe most tokens one request can hold, as the maker states it. Size alone says nothing about how well the model uses a long input; the Long context axis measures that. | 256K | Artificial Analysis | Oct 27, 2026 | |
| Max outputThe most tokens the model writes in one response. | 262K | no Alibaba figure in the stored maker sources; OpenRouter lists 262,144 | OpenRouter | Oct 29, 2026 |
| ReadsThe kinds of input the model accepts. | Text, Images, Video | Artificial Analysis | Oct 27, 2026 | |
| LicenceThe terms the weights or the service are offered under. | Apache 2.0 | Artificial Analysis | Oct 27, 2026 | |
| Open weightsWhether the maker publishes the weights for anyone to run. | Yes | Artificial Analysis | Oct 27, 2026 | |
| Routes offering itOf the 19 clouds, gateways and coding products GILD tracks, how many offer the release today, preview included. | 3 of 19 | GILD route matrix | Oct 29, 2026 | |
| Cost | ||||
| Answer tokens per taskLower is better. Answer tokens per Intelligence Index task, reasoning excluded. | 19,092 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Cost per task, cache readsLower is better. The cache-read share of AA's cost per Intelligence Index task. | $0.34 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Cost per task, cache writesLower is better. The cache-write share of AA's cost per Intelligence Index task. | $0.6 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Cost per task, inputLower is better. The input-token share of AA's cost per Intelligence Index task. | $0.95 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Cost per task, outputLower is better. The answer-token share of AA's cost per Intelligence Index task. | $0.2 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Cost per task, reasoningLower is better. The reasoning-token share of AA's cost per Intelligence Index task. | $0.14 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Cost per taskLower is better. What one Intelligence Index task cost AA at list price, input, cache, output and reasoning tokens together. | $1.15 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Cost to run the indexLower is better. What the whole Intelligence Index run cost AA at list price. The runs cost from tens of dollars to about $13,000, so the axis is log from $10 to $100,000. | $1,459 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Output tokens per taskLower is better. Tokens the model wrote per Intelligence Index task, reasoning included: how verbose it is. | 66,783 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Reasoning tokens per taskLower is better. Reasoning tokens per Intelligence Index task. | 47,692 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Speed | ||||
| End-to-end time, 100K promptLower is better. Median seconds for a whole response with a 100,000-token prompt. | 47 s | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| End-to-end response timeLower is better. Seconds AA measures for a whole response on its standard prompt. | 64 s | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Time to first answer token, 100K promptLower is better. Median seconds to the first answer token with a 100,000-token prompt. | 41 s | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Time to first answer tokenLower is better. Seconds until the first answer token, after any reasoning, on AA's API runs. | 52 s | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Output speed, 100K promptMedian output tokens per second when the prompt is about 100,000 tokens long. | 83 tokens/s | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Output speedMedian output tokens per second on AA's API runs, with the 5th and 95th percentile when AA prints them. | 42 tokens/s | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Time per taskLower is better. Wall-clock seconds per Intelligence Index task. Runs take from about 15 s to about 33 min, so the axis is log from 1 s to 10,000 s. | 1,201 s | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Time to first token, 100K promptLower is better. Median seconds to the first chunk when the prompt is about 100,000 tokens long: long-input latency, separate from window size. | 17 s | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Time to first tokenLower is better. Median seconds to the first streamed chunk on AA's API runs, with the 5th and 95th percentile when AA prints them. Reasoning models spend this time thinking. | 3.9 s | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Reliability | ||||
| Hallucination rateLower is better. AA-Omniscience hallucination rate shows how often the model answers wrongly when it does not know and should decline. | 28.6% | Extra-high effort | Artificial Analysis | Nov 2, 2026 |
| Omniscience accuracyShare of AA-Omniscience knowledge questions answered correctly. | 17.3% | Extra-high effort | Artificial Analysis | Nov 2, 2026 |
| Omniscience indexAA-Omniscience index: correct answers minus wrong answers, declines neutral, -100 to 100. | -10 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Knowledge work | ||||
| AA-BriefcaseAA-Briefcase overall Elo for long business deliverables, with AA's 95% interval. | 1,393 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| APEX-Agents (maintainers)APEX-Agents pass@1 from the maintainers, as Epoch AI republishes it. | 47.5% | Mercor (via Epoch AI) | Oct 26, 2026 | |
| GDP-PDF (AA run)Share of GDP-PDF document tasks where every check passes. | 16.4% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| GDPval-AAGDPval-AA Elo: AA's run of economically valuable knowledge-work tasks, graded pairwise, with AA's interval. | 1,427 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| MLCR (AA run)AA's MLCR overall score for long, multi-document reading. | 22.8% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Capability beyond the chart | ||||
| AA-LCRAA long-context reasoning accuracy. | 82% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| ARC-AGI-2ARC-AGI-2 score from the ARC Prize maintainers, as Epoch AI republishes it. | 42.4% | Extra-high effort | ARC Prize Foundation (via Epoch AI) | Oct 26, 2026 |
| CritPt (AA run)Share of CritPt research-level physics problems solved in AA's run. | 5.4% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| DTBenchDTBench accuracy, as Epoch AI republishes it. | 88% | Redwood Research (via Epoch AI) | Oct 26, 2026 | |
| EnterpriseOps-Gym (AA run)AA's EnterpriseOps-Gym score for enterprise operations agents. | 44.2% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| FrontierCode (AA run)AA's FrontierCode score: hard, unsaturated coding tasks. | 34.2% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| GPQA Diamond (AA run)GPQA Diamond accuracy in AA's run. | 90.5% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Humanity's Last Exam (AA run)Share of Humanity's Last Exam questions answered correctly in AA's run. | 33.9% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Intelligence IndexArtificial Analysis Intelligence Index: AA's composite of its own evaluation runs, 0 to 100 points. | 33.7 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| LMCALMCA score, 0 to 100, as Epoch AI republishes it. Its interval is printed only as a half-width, so it is not drawn. | 41.4 | Redwood Research (via Epoch AI) | Oct 26, 2026 | |
| MMMU-Pro (AA run)Multimodal understanding accuracy on MMMU-Pro in AA's run. | 76.3% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| ProofBenchShare of ProofBench proofs graded correct, from Vals AI as Epoch AI republishes it. | 16% | Vals AI (via Epoch AI) | Oct 26, 2026 | |
| SciCode (AA run)SciCode subproblem accuracy in AA's run. | 46.6% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| tau-Banking (AA run)AA's tau-Banking tool-use score. | 48.0% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Terminal-Bench 4.0 (AA run)Share of Terminal-Bench 4.0 tasks solved in AA's own harness. | 5.6% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Terminal-Bench Science (AA run)Share of Terminal-Bench Science tasks solved in AA's harness. | 0.5% | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| WebDev ArenaWebDev Arena score from human pairwise votes on web builds, with its 95% interval, as Epoch AI republishes it. | 1,593 | LMArena (via Epoch AI) | Oct 26, 2026 | |
| Domains | ||||
| EconomicsArtificial Analysis capability score for economics questions, 0 to 100 points. | 42.8 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| EngineeringArtificial Analysis capability score for engineering questions, 0 to 100 points. | 33.3 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Finance and accountingArtificial Analysis capability score for finance and accounting questions, 0 to 100 points. | 34.3 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Healthcare and medicalArtificial Analysis capability score for healthcare and medical questions, 0 to 100 points. | 34.6 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| LegalArtificial Analysis capability score for legal questions, 0 to 100 points. | 34.6 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
| Strategy and operationsArtificial Analysis capability score for strategy and operations questions, 0 to 100 points. | 37.1 | Qwen3.8 27B (Xhigh) | Artificial Analysis | Oct 27, 2026 |
Where Qwen3.8 27B is offered, what each route charges, and how each endpoint is holding up.
3 of 19 routes GILD tracks offer Qwen3.8 27B today, preview included. Read Oct 29, 2026 from each route's own pages.
| Route | Status | Model ID | Limits and lifecycle | Sources |
|---|---|---|---|---|
| The maker's own API | Available | qwen3.8-27b | Alibaba Cloud Model Studio, International and China (Beijing) deployments; up to 1M input tokens per request | Alibaba Cloud |
| GitHub Models | Retired | not applicableservice retired | service retired July 30, 2026 | GitHub |
| Microsoft Foundry | Preview | Qwen3.8-27B | Preview in the open-weight fine-tuning table: managed compute or Fireworks deployment, no serverless | Microsoft |
| OpenRouter | Available | qwen/qwen3.8-27b | 1,000,000 context for the model; top provider 262,144 output | OpenRouter |
Not offered on 10 routes: Amazon Bedrock, Antigravity, Claude on Google Cloud (Anthropic managed), Claude Platform on AWS, Cursor, Databricks, GitHub Copilot, Google Cloud Vertex / Agent Platform (Google managed), OpenCode and Snowflake Cortex.
5 routes do not say: Claude Code, Codex, Gemini CLI, Grok Build and Windsurf / Devin.
| Route | Status | Model ID | Limits and lifecycle | Sources |
|---|---|---|---|---|
| Amazon Bedrock | Not offered | Bedrock lists Qwen3 235B, Qwen3 32B, Qwen3 Coder and Qwen3 Next models; Qwen3.8 27B isn't among them | Amazon Web Services | |
| Antigravity | Not offered | Antigravity lists Gemini, Claude and GPT-OSS models only | ||
| Claude on Google Cloud (Anthropic managed) | Not offered | Takes the Claude API's model IDs, which name Anthropic's Claude models only | Anthropic, Claude Models on Google Cloud (Anthropic managed)Anthropic, Models overview | |
| Claude Platform on AWS | Not offered | Claude Platform on AWS lists Anthropic's Claude models only | Anthropic | |
| Cursor | Not offered | absent from Cursor's model table | Cursor | |
| Databricks | Not offered | Databricks lists Qwen3.5 and Qwen3-Next models; Qwen3.8 27B isn't among them | Databricks | |
| GitHub Copilot | Not offered | Absent from the Copilot supported-models table, which lists each supported model | GitHub | |
| Google Cloud Vertex / Agent Platform (Google managed) | Not offered | Google lists Qwen 3 Next, Qwen 3 Coder and Qwen 3 235B; Qwen3.8 27B isn't among them | Google Cloud | |
| OpenCode | Not offered | OpenCode Zen and Go list Qwen3.8 Max and Qwen3.8 Flash; Qwen3.8 27B isn't among them | OpenCode, ModelsOpenCode, Go | |
| Snowflake Cortex | Not offered | Cortex lists Qwen3 32B, Qwen3 Next 80B and Qwen3 VL 235B; Qwen3.8 27B isn't among them | Snowflake | |
| Claude Code | Not stated | Alibaba's Claude Code guide names qwen3.8-flash and qwen3.8-max; Qwen3.8 27B isn't among them; Anthropic documents no other model | Alibaba CloudAnthropic | |
| Codex | Not stated | Codex docs list OpenAI models only; other models need a custom Responses API provider | OpenAI | |
| Gemini CLI | Not stated | Gemini CLI's model page names Gemini models only | ||
| Grok Build | Not stated | Grok Build pages name only grok-4.7 | xAI (SpaceXSI) | |
| Windsurf / Devin | Not stated | absent from Devin model data | Cognition |
The lowest standard rate is Chutes (fp8) through OpenRouter, at $0.039 / $1.25 per million input and output tokens. US dollars per million tokens, as each route lists them, one row per route and rate plan, cheapest standard rate first after the maker's own; a blended rate states its mix. OpenRouter's endpoints follow under one heading, each with its monitor's uptime over 1 day and 30 minutes and the context and output it serves.
| Route | Standard, in / out | Cache read | Other rates | Source, or uptime (1 day / 30 min) and limits |
|---|---|---|---|---|
| Alibaba Cloud Model StudioMaker | $0.5 / $3 | Alibaba Cloud, Oct 28, 2026 | ||
| OpenRouter | $0.2 / $2.50 | $0.05 | OpenRouter, Oct 29, 2026 | |
| Artificial Analysis price record | $0.5 / $3 | $0.1 | Blended $1.13, 3 input : 1 output, no cacheBlended $0.47, 7 cache-hit : 2 input : 1 output | Artificial Analysis, Oct 27, 2026 |
| Through OpenRouter, 21 provider endpoints. OpenRouter, Oct 29, 2026 | ||||
| Chutes (fp8)Lowest | $0.039 / $1.25 | $0.0039 | Up 99.9% / 100%262K context, 66K output | |
| Near AI (fp8) | $0.04 / $1.35 | $0.018 | Up 100% / 100%262K context, 66K output | |
| Tenstorrent (fp4) | $0.15 / $1.50 | $0.03 | Up 99.8% / 100%262K context, 66K output | |
| Ionstream (fp8) | $0.04 / $1.95 | $0.02 | Up 98.4% / 100%262K context, 66K output | |
| Darkbloom (fp4) | $0.035 / $2.20 | $0.018 | Up 97.4% / 100%262K context, 33K output | |
| Reka (fp8) | $0.04 / $2.20 | $0.02 | Up 98.6% / 100%262K context, 236K output | |
| DeepInfra (bf16)25% discount included | $0.15 / $1.88 | $0.037 | Up 100% / 100%262K context, 236K output | |
| Modal | $0.04 / $2.30 | $0.02 | Up 100% / 100%262K context, 236K output | |
| Wafer (fp8) | $0.06 / $2.30 | $0.059 | Up 100% / 100%262K context, 236K output | |
| DekaLLM | $0.04 / $2.50 | $0.02 | Up 99.4% / 100%262K context, 236K output | |
| AkashML (fp8) | $0.23 / $1.98 | $0.05 | Up 100% / 100%262K context, 131K output | |
| Parasail (fp8) | $0.24 / $2.20 | $0.05 | Up 99.9% / 100%262K context, 236K output | |
| Mancer 2 (fp8) | $0.18 / $2.50 | Up 95.0% / 100%262K context, 236K output | ||
| ModelRun (fp4) | $0.2 / $2.50 | $0.09 | Up 99.9% / 93.3%262K context, 236K output | |
| Phala | $0.2 / $2.50 | $0.05 | Up 99.9% / 100%1M context, 262K output | |
| Alibaba | $0.42 / $2.55 | $0.085 | Cache write $0.53, 5-minute cache | Up 87.6% / 100%1M context, 131K output |
| CoreWeave (fp8) | $0.4 / $3 | $0.15 | Up 98.9% / 100%262K context, 236K output | |
| Novita | $0.42 / $3 | $0.085 | Up 100% / 100%1M context, 131K output | |
| Cerebras (fp16) | $0.99 / $1.49 | $0.99 | Up 100% / 100%66K context, 33K output | |
| Cloudflare | $0.45 / $3.20 | $0.05 | Up 96.7%262K context, 236K output | |
| Venice (fp8) | $0.45 / $3.20 | Up 100% / 100%262K context, 66K output | ||
Alibaba's 2 releases in 1 family, oldest to newest along each tier, with list price and speed. Qwen3.8 27B is lit.
CurrentLegacyThis model
Price is the list price per 1M tokens, input / output. Speed is median output tokens per second. Bars share one scale across the lineup. Read between Oct 28, 2026 and Nov 2, 2026.
Alibaba's Qwen family of open-weight and hosted models.
2 releases
The layers of Agentic Software Development that Qwen3.8 27B can power. A product supplies the rest.
Product & Engineering, Software Development
Qwen3.8 27B can power coding, reasoning, and validation work inside an agentic software-development product. The Model does not itself provide the surrounding interface, execution environment, or system of record.
The Model can assist with work planning & task decomposition when a Product supplies the necessary context and tools.
The Model can assist with codebase context & intelligence when a Product supplies the necessary context and tools.
The Model can assist with coding & implementation when a Product supplies the necessary context and tools.
The Model can assist with debugging & investigation when a Product supplies the necessary context and tools.
The Model can assist with testing & verification when a Product supplies the necessary context and tools.
The Model can assist with code review & quality when a Product supplies the necessary context and tools.
Strongest on Long context, weakest on Developer experience.
Each figure is the share of accounts naming Qwen3.8 27B that speak well of it on that axis. An axis is scored once praise and concerns are both on record from at least five accounts by three authors. An account from the maker, a company that sells or serves the model, or the maker's expert program is listed and counts toward no figure.
| Axis | Favorable | Accounts |
|---|---|---|
| Quality and reasoningWhether its answers and code are right on the author's own task: reasoning, accuracy, instruction following, and consistency. | 71% | 24 favorable, 10 not, 34 authors |
| Tool use and structured outputWhether it calls tools correctly, returns valid structured output, and keeps agent loops on track. | 46% | 6 favorable, 7 not, 13 authors |
| Long contextHow it holds up over long documents, large codebases, long sessions, and many images or PDFs. | 75% | 6 favorable, 2 not, 8 authors |
| Developer experienceHow it is to build with: prompting, steering, effort settings, and support across SDKs and providers. | 17% | 1 favorable, 5 not, 6 authors |
| CostWhat the work costs: price per task, token use, and what caching and batch save. | Needs 5 accounts from 3 authors | 2 favorable, 2 not, 4 authors |
| SpeedResponse time, time to first token, and throughput. | 33% | 7 favorable, 14 not, 21 authors |
| ReliabilityWhether requests keep succeeding: overloaded errors, outages, rate limits, and changes that broke what worked. | Only concerns on record | 0 favorable, 9 not, 9 authors |
| Axis | Qwen3.8 27B | Qwen3.8 Max | Claude Haiku 5.5 | Claude Sonnet 5.5 | Claude Opus 5.5 | Claude Fable 5.1 | Claude Opus 5 | Claude Sonnet 5 | Claude Fable 5 | Claude Opus 4.8 | Claude Opus 4.7 | Claude Sonnet 4.6 | Claude Opus 4.6 | Claude Opus 4.5 | Claude Haiku 4.5 | Claude Sonnet 4.5 | GPT-6.1 Terra | GPT-6.1 Sol | GPT-6 Luna | GPT-6 Astra | GPT-5.6 Sol | GPT-5.6 Terra | GPT-5.6 Luna | GPT-5.5 | GPT-5.4 | gpt-oss-120b | GPT-6 Sol | GPT-5.3-Codex | Gemini 4 Argon | Gemini 3.8 Flash | Gemma 4 31B | Gemini 3.1 Pro Preview | Gemini 3.6 Flash | DeepSeek V4.1 Flash | DeepSeek V4 Pro | Kimi K3.1 Pro | Kimi K3 | Kimi K2.7 Code | Mistral Large 4 | Mistral Medium 3.5 | Grok 4.7 | Grok 4.6 | Grok 4.5 | MiniMax M3.1 Flash | Mercury 3 | GLM-5.3-Flash | GLM-5.3 | GLM-5.2 | Muse Spark Open | Muse Wonder | Muse Spark 1.3 | Llama 4 Scout | Llama 4 Maverick | MiMo-V2.6-Pro | MiMo-V2.6-Flash | Ling 3.1 Flash | Step 5 Preview |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Quality and reasoning | 71%24 favorable, 10 not, 34 authors | 57%4 favorable, 3 not, 7 authors | 73%19 favorable, 7 not, 26 authors | 64%14 favorable, 8 not, 22 authors | 68%17 favorable, 8 not, 25 authors | 54%15 favorable, 13 not, 28 authors | 50%6 favorable, 6 not, 12 authors | 56%9 favorable, 7 not, 16 authors | 68%13 favorable, 6 not, 18 authors | 68%17 favorable, 8 not, 25 authors | 57%12 favorable, 9 not, 21 authors | 67%12 favorable, 6 not, 18 authors | 70%19 favorable, 8 not, 27 authors | 62%13 favorable, 8 not, 20 authors | 58%14 favorable, 10 not, 24 authors | 69%11 favorable, 5 not, 16 authors | 33%3 favorable, 6 not, 8 authors | 55%12 favorable, 10 not, 22 authors | 55%16 favorable, 13 not, 29 authors | 44%12 favorable, 15 not, 26 authors | 33%3 favorable, 6 not, 9 authors | 38%3 favorable, 5 not, 8 authors | Needs 5 accounts from 3 authors3 favorable, 1 not, 4 authors | 33%4 favorable, 8 not, 12 authors | 33%2 favorable, 4 not, 6 authors | 58%22 favorable, 16 not, 38 authors | 31%10 favorable, 22 not, 32 authors | Needs 5 accounts from 3 authors1 favorable, 3 not, 4 authors | 63%22 favorable, 13 not, 35 authors | 56%27 favorable, 21 not, 45 authors | 80%24 favorable, 6 not, 28 authors | 56%20 favorable, 16 not, 36 authors | Needs 5 accounts from 3 authors1 favorable, 3 not, 4 authors | 61%25 favorable, 16 not, 40 authors | Only concerns on record0 favorable, 4 not, 4 authors | 59%20 favorable, 14 not, 32 authors | Only praise on record3 favorable, 0 not, 3 authors | 50%3 favorable, 3 not, 6 authors | 58%11 favorable, 8 not, 18 authors | 36%5 favorable, 9 not, 14 authors | 43%16 favorable, 21 not, 36 authors | 86%6 favorable, 1 not, 7 authors | 60%3 favorable, 2 not, 5 authors | 62%13 favorable, 8 not, 21 authors | 86%18 favorable, 3 not, 21 authors | 67%14 favorable, 7 not, 21 authors | 76%47 favorable, 15 not, 61 authors | 71%5 favorable, 2 not, 7 authors | Needs 5 accounts from 3 authors2 favorable, 1 not, 3 authors | 20%1 favorable, 4 not, 5 authors | Only praise on record2 favorable, 0 not, 2 authors | 53%8 favorable, 7 not, 15 authors | 44%8 favorable, 10 not, 17 authors | 22%2 favorable, 7 not, 9 authors | 40%4 favorable, 6 not, 10 authors | Only concerns on record0 favorable, 1 not, 1 author | Needs 5 accounts from 3 authors2 favorable, 1 not, 3 authors |
| Tool use and structured output | 46%6 favorable, 7 not, 13 authors | Only praise on record1 favorable, 0 not, 1 author | 67%6 favorable, 3 not, 9 authors | 40%4 favorable, 6 not, 10 authors | 46%6 favorable, 7 not, 13 authors | 30%3 favorable, 7 not, 10 authors | Needs 5 accounts from 3 authors3 favorable, 1 not, 4 authors | 70%7 favorable, 3 not, 10 authors | 57%4 favorable, 3 not, 7 authors | 50%4 favorable, 4 not, 8 authors | 50%4 favorable, 4 not, 8 authors | 29%2 favorable, 5 not, 7 authors | 33%4 favorable, 8 not, 12 authors | 70%7 favorable, 3 not, 10 authors | 43%3 favorable, 4 not, 6 authors | 50%3 favorable, 3 not, 6 authors | 40%2 favorable, 3 not, 5 authors | 40%4 favorable, 6 not, 10 authors | 33%3 favorable, 6 not, 9 authors | 62%8 favorable, 5 not, 13 authors | No accounts yet | Only concerns on record0 favorable, 2 not, 2 authors | Only praise on record1 favorable, 0 not, 1 author | Only praise on record1 favorable, 0 not, 1 author | No accounts yet | 27%4 favorable, 11 not, 15 authors | 56%5 favorable, 4 not, 9 authors | No accounts yet | 25%2 favorable, 6 not, 8 authors | 47%7 favorable, 8 not, 15 authors | 67%4 favorable, 2 not, 6 authors | 54%7 favorable, 6 not, 12 authors | Only concerns on record0 favorable, 1 not, 1 author | 59%10 favorable, 7 not, 17 authors | Only concerns on record0 favorable, 1 not, 1 author | Needs 5 accounts from 3 authors3 favorable, 1 not, 4 authors | Only concerns on record0 favorable, 1 not, 1 author | No accounts yet | 38%5 favorable, 8 not, 13 authors | Only concerns on record0 favorable, 5 not, 5 authors | 38%6 favorable, 10 not, 16 authors | Only praise on record2 favorable, 0 not, 2 authors | Only concerns on record0 favorable, 1 not, 1 author | 67%4 favorable, 2 not, 6 authors | 80%8 favorable, 2 not, 10 authors | 33%2 favorable, 4 not, 6 authors | 57%4 favorable, 3 not, 7 authors | No accounts yet | No accounts yet | Only concerns on record0 favorable, 1 not, 1 author | Needs 5 accounts from 3 authors1 favorable, 1 not, 2 authors | Needs 5 accounts from 3 authors1 favorable, 2 not, 3 authors | Only concerns on record0 favorable, 4 not, 4 authors | Only concerns on record0 favorable, 5 not, 5 authors | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 1 not, 1 author |
| Long context | 75%6 favorable, 2 not, 8 authors | Only praise on record1 favorable, 0 not, 1 author | 29%2 favorable, 5 not, 7 authors | 60%3 favorable, 2 not, 5 authors | 80%8 favorable, 2 not, 10 authors | 63%5 favorable, 3 not, 8 authors | 67%4 favorable, 2 not, 6 authors | 50%3 favorable, 3 not, 6 authors | 33%2 favorable, 4 not, 6 authors | 60%6 favorable, 4 not, 10 authors | 50%4 favorable, 4 not, 7 authors | 71%5 favorable, 2 not, 7 authors | 64%7 favorable, 4 not, 11 authors | 40%4 favorable, 6 not, 10 authors | 40%2 favorable, 3 not, 5 authors | 50%4 favorable, 4 not, 8 authors | Only concerns on record0 favorable, 1 not, 1 author | 38%3 favorable, 5 not, 8 authors | 20%1 favorable, 4 not, 5 authors | 27%3 favorable, 8 not, 11 authors | No accounts yet | No accounts yet | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 1 not, 1 author | Needs 5 accounts from 3 authors2 favorable, 1 not, 3 authors | 25%2 favorable, 6 not, 8 authors | Only concerns on record0 favorable, 3 not, 3 authors | No accounts yet | 25%2 favorable, 6 not, 8 authors | 38%5 favorable, 8 not, 13 authors | 20%1 favorable, 4 not, 5 authors | 44%7 favorable, 9 not, 16 authors | Only praise on record1 favorable, 0 not, 1 author | 58%7 favorable, 5 not, 12 authors | No accounts yet | Needs 5 accounts from 3 authors3 favorable, 1 not, 4 authors | Only praise on record1 favorable, 0 not, 1 author | Only concerns on record0 favorable, 1 not, 1 author | Needs 5 accounts from 3 authors1 favorable, 3 not, 4 authors | No accounts yet | 42%5 favorable, 7 not, 12 authors | No accounts yet | No accounts yet | 40%2 favorable, 3 not, 5 authors | 60%3 favorable, 2 not, 5 authors | No accounts yet | 40%2 favorable, 3 not, 5 authors | No accounts yet | No accounts yet | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 3 not, 3 authors | Needs 5 accounts from 3 authors2 favorable, 1 not, 3 authors | Needs 5 accounts from 3 authors1 favorable, 1 not, 2 authors | Needs 5 accounts from 3 authors1 favorable, 1 not, 2 authors | No accounts yet | No accounts yet |
| Developer experience | 17%1 favorable, 5 not, 6 authors | Only concerns on record0 favorable, 1 not, 1 author | 25%2 favorable, 6 not, 8 authors | 38%5 favorable, 8 not, 13 authors | 38%6 favorable, 10 not, 16 authors | 50%7 favorable, 7 not, 14 authors | 25%3 favorable, 9 not, 12 authors | 29%2 favorable, 5 not, 7 authors | 25%3 favorable, 9 not, 12 authors | 53%10 favorable, 9 not, 19 authors | 29%4 favorable, 10 not, 14 authors | 57%4 favorable, 3 not, 7 authors | 45%5 favorable, 6 not, 11 authors | 67%8 favorable, 4 not, 12 authors | Needs 5 accounts from 3 authors2 favorable, 2 not, 4 authors | 50%3 favorable, 3 not, 6 authors | Only concerns on record0 favorable, 2 not, 2 authors | 27%3 favorable, 8 not, 11 authors | 25%2 favorable, 6 not, 8 authors | 41%7 favorable, 10 not, 17 authors | No accounts yet | Only concerns on record0 favorable, 1 not, 1 author | No accounts yet | No accounts yet | No accounts yet | 14%1 favorable, 6 not, 7 authors | 25%3 favorable, 9 not, 12 authors | No accounts yet | 33%3 favorable, 6 not, 9 authors | 39%7 favorable, 11 not, 17 authors | Only concerns on record0 favorable, 7 not, 7 authors | 40%8 favorable, 12 not, 20 authors | No accounts yet | 35%8 favorable, 15 not, 23 authors | No accounts yet | 9%1 favorable, 10 not, 11 authors | No accounts yet | Only concerns on record0 favorable, 1 not, 1 author | 13%2 favorable, 14 not, 16 authors | Only concerns on record0 favorable, 9 not, 9 authors | 25%5 favorable, 15 not, 20 authors | No accounts yet | No accounts yet | Only concerns on record0 favorable, 7 not, 7 authors | 11%1 favorable, 8 not, 9 authors | Only concerns on record0 favorable, 3 not, 3 authors | 33%5 favorable, 10 not, 15 authors | No accounts yet | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 1 not, 1 author | No accounts yet | Only concerns on record0 favorable, 6 not, 6 authors | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 1 not, 1 author | No accounts yet | No accounts yet |
| Cost | Needs 5 accounts from 3 authors2 favorable, 2 not, 4 authors | Only concerns on record0 favorable, 2 not, 2 authors | 69%20 favorable, 9 not, 29 authors | 45%10 favorable, 12 not, 22 authors | 56%15 favorable, 12 not, 27 authors | 20%4 favorable, 16 not, 20 authors | 43%3 favorable, 4 not, 7 authors | 39%7 favorable, 11 not, 17 authors | 8%1 favorable, 11 not, 12 authors | 40%6 favorable, 9 not, 14 authors | 50%7 favorable, 7 not, 13 authors | 50%6 favorable, 6 not, 12 authors | 33%7 favorable, 14 not, 20 authors | 53%8 favorable, 7 not, 15 authors | 29%4 favorable, 10 not, 12 authors | 38%3 favorable, 5 not, 8 authors | 80%8 favorable, 2 not, 9 authors | 74%14 favorable, 5 not, 19 authors | 79%22 favorable, 6 not, 26 authors | 29%7 favorable, 17 not, 23 authors | 57%4 favorable, 3 not, 7 authors | Only concerns on record0 favorable, 1 not, 1 author | 50%3 favorable, 3 not, 6 authors | Needs 5 accounts from 3 authors1 favorable, 3 not, 4 authors | 63%5 favorable, 3 not, 8 authors | 60%3 favorable, 2 not, 5 authors | 55%12 favorable, 10 not, 21 authors | Needs 5 accounts from 3 authors2 favorable, 1 not, 3 authors | 35%7 favorable, 13 not, 20 authors | 58%14 favorable, 10 not, 23 authors | Only praise on record7 favorable, 0 not, 7 authors | 50%8 favorable, 8 not, 16 authors | Only concerns on record0 favorable, 1 not, 1 author | 66%25 favorable, 13 not, 37 authors | Only praise on record2 favorable, 0 not, 2 authors | 40%10 favorable, 15 not, 25 authors | 71%5 favorable, 2 not, 7 authors | Needs 5 accounts from 3 authors1 favorable, 3 not, 4 authors | 27%3 favorable, 8 not, 11 authors | Only concerns on record0 favorable, 8 not, 8 authors | 19%5 favorable, 21 not, 26 authors | 20%1 favorable, 4 not, 5 authors | Only praise on record4 favorable, 0 not, 4 authors | 80%12 favorable, 3 not, 15 authors | 50%6 favorable, 6 not, 12 authors | 76%16 favorable, 5 not, 21 authors | 35%8 favorable, 15 not, 23 authors | 71%5 favorable, 2 not, 7 authors | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 9 not, 9 authors | Needs 5 accounts from 3 authors2 favorable, 1 not, 3 authors | Only praise on record1 favorable, 0 not, 1 author | Only praise on record1 favorable, 0 not, 1 author | Needs 5 accounts from 3 authors1 favorable, 1 not, 2 authors | Only praise on record3 favorable, 0 not, 3 authors | Only praise on record1 favorable, 0 not, 1 author | Only praise on record1 favorable, 0 not, 1 author |
| Speed | 33%7 favorable, 14 not, 21 authors | Needs 5 accounts from 3 authors1 favorable, 3 not, 4 authors | 74%14 favorable, 5 not, 19 authors | 88%14 favorable, 2 not, 16 authors | 46%6 favorable, 7 not, 13 authors | 44%4 favorable, 5 not, 9 authors | 60%3 favorable, 2 not, 5 authors | 44%4 favorable, 5 not, 9 authors | 57%4 favorable, 3 not, 7 authors | 31%4 favorable, 9 not, 13 authors | 63%5 favorable, 3 not, 8 authors | 17%1 favorable, 5 not, 6 authors | 36%4 favorable, 7 not, 11 authors | 73%8 favorable, 3 not, 11 authors | 78%7 favorable, 2 not, 9 authors | 75%6 favorable, 2 not, 8 authors | 83%5 favorable, 1 not, 5 authors | 37%7 favorable, 12 not, 19 authors | 45%5 favorable, 6 not, 11 authors | 41%7 favorable, 10 not, 17 authors | Only praise on record1 favorable, 0 not, 1 author | Needs 5 accounts from 3 authors1 favorable, 1 not, 2 authors | 80%4 favorable, 1 not, 5 authors | Needs 5 accounts from 3 authors1 favorable, 1 not, 2 authors | No accounts yet | 85%23 favorable, 4 not, 27 authors | 57%4 favorable, 3 not, 7 authors | Only praise on record1 favorable, 0 not, 1 author | 45%5 favorable, 6 not, 11 authors | 61%19 favorable, 12 not, 31 authors | 53%10 favorable, 9 not, 17 authors | 35%6 favorable, 11 not, 16 authors | Needs 5 accounts from 3 authors2 favorable, 1 not, 3 authors | 68%21 favorable, 10 not, 30 authors | Only concerns on record0 favorable, 1 not, 1 author | 21%4 favorable, 15 not, 19 authors | Only concerns on record0 favorable, 2 not, 2 authors | No accounts yet | 21%3 favorable, 11 not, 14 authors | Only concerns on record0 favorable, 2 not, 2 authors | 29%5 favorable, 12 not, 17 authors | Needs 5 accounts from 3 authors1 favorable, 2 not, 3 authors | Only praise on record2 favorable, 0 not, 2 authors | 44%4 favorable, 5 not, 9 authors | 65%13 favorable, 7 not, 20 authors | 33%3 favorable, 6 not, 9 authors | 20%3 favorable, 12 not, 15 authors | Needs 5 accounts from 3 authors1 favorable, 1 not, 2 authors | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 1 not, 1 author | Needs 5 accounts from 3 authors1 favorable, 1 not, 2 authors | Needs 5 accounts from 3 authors3 favorable, 1 not, 4 authors | No accounts yet | Only concerns on record0 favorable, 4 not, 4 authors | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 2 not, 2 authors | Only concerns on record0 favorable, 1 not, 1 author |
| Reliability | Only concerns on record0 favorable, 9 not, 9 authors | Only concerns on record0 favorable, 1 not, 1 author | 20%1 favorable, 4 not, 5 authors | 18%2 favorable, 9 not, 11 authors | 13%1 favorable, 7 not, 8 authors | 9%1 favorable, 10 not, 11 authors | 13%1 favorable, 7 not, 8 authors | 63%5 favorable, 3 not, 7 authors | 22%2 favorable, 7 not, 9 authors | 17%2 favorable, 10 not, 12 authors | 18%2 favorable, 9 not, 11 authors | 17%1 favorable, 5 not, 6 authors | 20%3 favorable, 12 not, 15 authors | 38%6 favorable, 10 not, 16 authors | 29%2 favorable, 5 not, 7 authors | 40%4 favorable, 6 not, 10 authors | Only concerns on record0 favorable, 1 not, 1 author | 13%1 favorable, 7 not, 8 authors | Only concerns on record0 favorable, 5 not, 5 authors | 14%2 favorable, 12 not, 14 authors | Only concerns on record0 favorable, 4 not, 4 authors | Only concerns on record0 favorable, 1 not, 1 author | No accounts yet | Only concerns on record0 favorable, 2 not, 2 authors | Only concerns on record0 favorable, 4 not, 4 authors | Only concerns on record0 favorable, 4 not, 4 authors | 17%1 favorable, 5 not, 6 authors | Only concerns on record0 favorable, 3 not, 3 authors | 5%1 favorable, 18 not, 19 authors | 15%3 favorable, 17 not, 20 authors | Only concerns on record0 favorable, 5 not, 5 authors | 14%3 favorable, 19 not, 22 authors | Only concerns on record0 favorable, 1 not, 1 author | 42%5 favorable, 7 not, 12 authors | Needs 5 accounts from 3 authors1 favorable, 1 not, 2 authors | 8%1 favorable, 12 not, 13 authors | Only concerns on record0 favorable, 1 not, 1 author | Needs 5 accounts from 3 authors1 favorable, 1 not, 2 authors | 38%3 favorable, 5 not, 8 authors | Only concerns on record0 favorable, 4 not, 4 authors | 22%2 favorable, 7 not, 9 authors | Only concerns on record0 favorable, 1 not, 1 author | No accounts yet | 60%3 favorable, 2 not, 5 authors | 33%2 favorable, 4 not, 5 authors | Only concerns on record0 favorable, 7 not, 7 authors | Only concerns on record0 favorable, 4 not, 4 authors | Only concerns on record0 favorable, 1 not, 1 author | No accounts yet | Only concerns on record0 favorable, 2 not, 2 authors | Only concerns on record0 favorable, 1 not, 1 author | Needs 5 accounts from 3 authors1 favorable, 3 not, 4 authors | Only concerns on record0 favorable, 1 not, 1 author | Only concerns on record0 favorable, 2 not, 2 authors | No accounts yet | No accounts yet | Only concerns on record0 favorable, 1 not, 1 author |
GILD searched Hacker News and GitHub for accounts that name Qwen3.8 27B.
This is by far the best pelican SVG I've been able to generate with a model that runs on a local machine
Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things. Simon Willison, independent developer and blogger, self-described, Aug 16, 2026. Qwen3.8 27B as the 17GB Q4_K_M build in LM Studio on an M5 Max MacBook Pro and a DGX Spark.
Not only does my measurement of BF16 replicate the stated result, but, to my surprise, Q4_K_M does as well.
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses. Piotr Migdał, author on the Quesma blog, self-described, Aug 26, 2026. Qwen3.8 27B in BF16 and Unsloth Q8, Q4, Q2 and 1-bit quantizations on llama.cpp, GPQA Diamond, IFBench and Terminal-Bench 2.1.
the quality is much higher than Qwen 3.6 27B
Qwen 3.8 27B. lelandbatey, Hacker News commenter, self-described, Aug 14, 2026. Qwen3.8 27B as the Unsloth 2-bit quant on a 5070ti with 16GB of VRAM at 128k context through llama.cpp.
it failed my basic prompt to compose a vim regex to match CamelCaseWords
Qwen 3.8 27B. rasengan0, Hacker News commenter, self-described, Aug 15, 2026. Qwen3.8 27B as the Unsloth UD-Q4_K_XL and Ollama Q4_K_M quants on a Framework 12 i5 laptop with 48GB RAM.
I don't want to say it's as good as Claude (I use Sonnet primarily), but it's not far off
Qwen 3.8 27B is excellent, but it defaults to overthinking things. c16, Hacker News commenter, self-described, Aug 17, 2026. Qwen3.8 27B MLX in the author's own model harness, against Claude Sonnet.
around the same level as GPT 5.4 xhigh from march, OpenAIs leading model at that time
Norway should buy OpenAI. NorwegianDude, Hacker News commenter, self-described, Aug 18, 2026. Qwen3.8 27B on the author's personal PC at 85 to 95 tokens per second.
the dense (with more active parameters) makes a real difference in output quality
Ornith-1.5: From Self-Scaffolding to Self-Improvement. verdverm, Hacker News commenter, self-described, Aug 19, 2026. Qwen3.8 27B dense on an OEM DGX Spark, against mixture-of-experts models.
it's the first time I feel local coding models are actually functionally useable as daily drivers
Unsloth Dynamic 3.0 GGUFs. latentsea, Hacker News commenter, self-described, Aug 20, 2026. Qwen3.8 27B as a local coding model through Unsloth quants.
it struggles to do anything useful when I'm pretty sure Claude would have probably finished the same thing in a couple of hours
If this is true, the hyperscalers are toast. aslkalska, Hacker News commenter, self-described, Aug 21, 2026. the latest Qwen3.8 27B on the author's consumer-grade GPU.
I wouldn't trust those smaller models with the real work
Why your local LLM feels dumber than it is. asats, Hacker News commenter, self-described, Aug 23, 2026. Qwen3.8 27B on an M4 Max with a 40-core GPU and 128GB at 59.5 tokens per second.
Even a 4-bit quant of Qwen3.8 27b is indistinguishable from Gemini 3.7 flash in our internal tests
Why your local LLM feels dumber than it is. a11r, Hacker News commenter, self-described, Aug 23, 2026. a 4-bit quant of Qwen3.8 27B in the author's internal tests, on an RTX 5090 with ninfer.
It doesn't feel that far behind something like GPT 5.6 Luna
Apple caught off guard by AI demand for Mac Mini and Mac Studio. randomblock1, Hacker News commenter, self-described, Aug 31, 2026. Qwen3.8 27B at Q4_K_M with 131K context on a 7900 XTX 24GB at 55 tokens per second with MTP.
it sits somewhere between Sonnet 5 and Opus 5 capability
Apple caught off guard by AI demand for Mac Mini and Mac Studio. SamInTheShell, Hacker News commenter, self-described, Aug 31, 2026. Qwen3.8 27B at Q4_K_S on a Radeon 7900 XTX at 50 tokens per second, with 128k context.
Qwen3.8-27b didn't know that the test is about riding a bicycle, while all other larger models I tested (DeepSeek V4 Pro, Qwen3.8 Max, GLM 5.3, Kimi K3) drew the pelican riding a bicycle
Muse Spark 1.3. umajho, Hacker News commenter, self-described, Sep 3, 2026. Qwen3.8 27B on Simon Willison's pelican bicycle test against larger models.
the quality level is spectacular for the size
Qwen 3.8 27B available on Cerebras at 1500 tokens/s. gabri200, Hacker News commenter, self-described, Sep 4, 2026. Qwen3.8 27B under high concurrency with multi-token prediction.
it has crossed the threshold and is now a useful tool for coding and debugging
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses. kennywinker, Hacker News commenter, self-described, Sep 8, 2026. Qwen3.8 27B for coding and debugging, with its SWE-bench Pro score against Opus 4.6.
another personal benchmark problem (of a very different nature) that Qwen3.8-27B usually can't solve at all, while Opus and GLM-5.3-Flash solve it consistently
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses. anyfoo, Hacker News commenter, self-described, Sep 8, 2026. Qwen3.8 27B at Q5 and below on a personal benchmark problem, against Opus and GLM-5.3-Flash.
I have found qwen to be absolutely useless at anything but very specific, surgical code changes
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses. TomBombadildoze, Hacker News commenter, self-described, Sep 8, 2026. Qwen3.8 27B at 4-bit alongside a Claude Max subscription.
competitive at about Opus 4.5 to 4.7 level. That matches my experience in real tasks over the last few months
Nine coding harnesses vs. your laptop. suprjami, Hacker News commenter, self-described, Sep 11, 2026. Qwen3.8 27B in real tasks over several months of local inference.
it's pretty good at spotting dumb stuff you miss when you proofcheck your own code
Nine coding harnesses vs. your laptop. noir_lord, Hacker News commenter, self-described, Sep 11, 2026. Qwen3.8 27B on a 24GB VRAM GPU as a glorified linter.
I still haven't found a use case for Qwen3.8 27B that Qwen 3.6 35b A3b (MoE) is better at
Best LLM for every budget, updated daily. seanmcdirmid, Hacker News commenter, self-described, Sep 24, 2026. Qwen3.8 27B against Qwen 3.6 35b A3b on the author's machine at up to 40 tokens per second.
It is currently debugging some issues in a native Mac Swift application and getting through the list of issues just fine
Best LLM for every budget, updated daily. greggh, Hacker News commenter, self-described, Sep 24, 2026. a quant and tune of Qwen3.8 27B on an M1 Max 32GB MacBook with a Pi setup, debugging a Swift app overnight.
Qwen 3.8 has been the first local model I've tried that has consistently given usable and impressive results
Ask HN: Which model do you use for work?. praash, Hacker News commenter, self-described, Sep 26, 2026. Qwen3.8 27B MLX running locally on an Apple M4 48GB for technical suggestions and code snippets.
Qwen3.8-27B has been there for the past two months
Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s. stymaar, Hacker News commenter, self-described, Oct 4, 2026. Qwen3.8 27B for agentic coding against Opus 4.6, run at night on a slow GPU.
Qwen3.8-27B is surprisingly effective, somewhere in the vicinity of Opus 4.6
Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console. thombles, Hacker News commenter, self-described, Oct 17, 2026. Qwen3.8 27B on a jailbroken PS5 at low tens of tokens per second, around Opus 4.6.
Are they about on par with opus 4.6? Yes
DeepSeek-v4.1-Flash-1017. Pragmata, Hacker News commenter, self-described, Oct 17, 2026. Qwen3.8 27B at 2bpw and 3bpw quants on long-running tasks, against Opus.
Qwen 3.8 27b on my 5090, barely acceptable, thinks too long, sometimes freaks out
Kimi K3.1 scores 55 on Artificial Analysis, placed on the Pareto line. potsandpans, Hacker News commenter, self-described, Oct 24, 2026. Qwen3.8 27B on a 5090 for a PlayStation decompilation project against Opus and DeepSeek flash.
Qwen 3.8-27B is the current golden child if you have >24GB VRAM
Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware. PaulKeeble, Hacker News commenter, self-described, Oct 17, 2026. Qwen3.8-27B as a dense local model needing more than 24GB VRAM, against mixture-of-experts models.
I just can't believe my eyes i.r.t. to how good this model is
GLM-5.3 is now open-weight. rubin55, Hacker News commenter, self-described, Aug 29, 2026. Qwen3.8 27B tested for a week by an intensive GLM-5.2 and Opus 5 user.
It fails the simple clock test for me which Qwen3.8 27B got (nearly) right
DeepSeek-v4-flash-vision-exp. leumon, Hacker News commenter, self-described, Aug 21, 2026. Qwen3.8 27B on a clock-reading image test against DeepSeek v4 flash vision.
both those models will generate an enormous amount of noise
IBM CEO says open weight models are now good and cheap on-prem. dekhn, Hacker News commenter, self-described, Oct 26, 2026. Qwen3.8 27B on ninfer on a 5090 for a web-app coding task, against Claude and ChatGPT.
produces systematic Tamil agglutinative-suffix corruption on medical-domain generation that Qwen3.6-27B does not
Tamil (agglutinative-language) quality regression vs Qwen3.6-27B, not fixed by better DeltaNet quantization protection. manoj-relusys, GitHub issue author, self-described, Sep 8, 2026. quantized Qwen3.8-27B checkpoints on vLLM for Tamil medical-domain generation.
Qwen 3.8 27B Q4_K_M is good enough for the tasks I have currently (C++20 coding on 1.3M LoC code base)
Post by @AgiMan_WCL. Agi Man, X user, self-described, Oct 27, 2026. Qwen3.8 27B Q4_K_M running locally on 24GB VRAM at 160K context for C++20 work on a 1.3M-line codebase.
I just tried on the free qwen3.8:27b I'm running at home and it answered correctly straight away
Post by @kjsnioctib. kjsnioctib, X user, self-described, Oct 27, 2026. the free qwen3.8:27b the author runs at home, on a single question.
This is such a good match
Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things. Simon Willison, independent developer and blogger, self-described, Aug 16, 2026. Qwen3.8 27B as the 17GB Q4_K_M build in LM Studio on an M5 Max MacBook Pro and a DGX Spark.
Using opencode and it built a old fashioned arcade vertical shooter with no issues
Why your local LLM feels dumber than it is. IronWolve, Hacker News commenter, self-described, Aug 22, 2026. Qwen3.8 27B NVFP4 on an RTX 5090 with SGLang in opencode, medium reasoning, 96k context.
it did ocr, wrote scripts, organized everything neatly
I gave Qwen 3.8 27B a reverse-engineering job and it finished in 30 minutes. pi-victor, Hacker News commenter, self-described, Aug 23, 2026. Qwen3.8 27B on an RTX 4090 and RTX 3070 with the Pi harness and the pi-llama plugin, reading invoices and bills.
Qwen 3.8 27b in my experience is more than capable of churning out features overnight with the right tools
vLLM v0.28.0. nejch, Hacker News commenter, self-described, Aug 30, 2026. Qwen3.8 27B served with data parallelism for hundreds of parallel requests.
multi-hour autonomous output with nothing more than a 5090, Deepseek Harness, and Qwen 3.8 27b Quasar NVFP4
Local AI Is Dead. You Are at the Funeral. diablozzq, Hacker News commenter, self-described, Aug 31, 2026. Qwen3.8 27B Quasar NVFP4 on a single 5090 with the DeepSeek Harness, multi-hour autonomous runs.
I've ran some agentic stuff with Qwen3.8-27B-UD-Q4_K_M on my RTX 3090. It's fast enough to be usable in my opinion
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses. sidewndr46, Hacker News commenter, self-described, Sep 8, 2026. Qwen3.8-27B-UD-Q4_K_M on an RTX 3090 for agentic work.
is more than capable of controlling my sonarr and radarr stuff for downloading and managing and organizing my media library but will flatly refuse to do any of that
There are now 5 inference providers for abliterated DeepSeek. wincy, Hacker News commenter, self-described, Oct 27, 2026. Qwen3.8 27B running locally to control Sonarr and Radarr media tools.
raises on any `system` message that is not the first element of `messages`
Qwen3.8-27B chat template raises on a system message that is not first, breaking agent harnesses that inject per-turn context. Nitjsefnie, GitHub issue author, self-described, Sep 22, 2026. Qwen3.8-27B served with llama-server, agent harness injecting mid-conversation system messages.
tool calling works only for short/simple prompts, but fails for longer prompts with more detailed system instructions, producing a plain text response instead of a tool_calls object
[Bug] Tool calling becomes unreliable with long prompts when enable_thinking=false (Qwen3.8-27B/Qwen3.8-27B-FP8). wuhongmei, GitHub issue author, self-described, Sep 7, 2026. Qwen3.8-27B and Qwen3.8-27B-FP8 served with SGLang, enable_thinking false.
the model persistently outputs left_click as the chosen action, even though this action is explicitly prohibited by the prompt
Qwen3.8-27B consistently outputs left_click action despite SYSTEM_PROMPT restriction in mobile GUI environment.. yinhao1102, GitHub issue author, self-described, Aug 19, 2026. Qwen3.8-27B on a 4-card H800 cluster in a mobile GUI automation task with a restricted action set.
Passing such history back through `tokenizer.apply_chat_template` raises instead of rendering the conversation
Qwen3.8 chat template crashes on OpenAI JSON-string tool arguments. Thump604, GitHub issue author, self-described, Aug 14, 2026. Qwen/Qwen3.8-27B chat template applied to OpenAI-compatible assistant history with serialized tool-call arguments.
No tool call is produced. No file is read
[Bug] qwen3.8-27b says "let me look at the file" but emits no tool call, then concludes without evidence (thinking-only / tool-call dropped). Lunar-Ele, GitHub issue author, self-described, Oct 27, 2026. qwen3.8-27b served with SGLang v0.5.22 in an agentic file-reading task.
tool calling only works when the model jumps straight to a tool call with an **empty** `content` field
qwen3.8:27b-mlx never emits tool_calls when the assistant produces free-text content first (only works when content is empty). lgdu, GitHub issue author, self-described, Oct 28, 2026. qwen3.8:27b-mlx on Ollama 0.34.1 on an Apple M4 Pro with 48GB, agent prompts asking for a preamble before the tool call.
The 262k context means a week of feeds fits in a single prompt.
Run Qwen3.8 27B locally: real numbers from my Mac Studio. TerminalBytes, independent tech blog, self-described, Aug 27, 2026. Qwen3.8 27B as the Ollama Q4_K_M build on a Mac Studio M3 Ultra, five timed runs against qwen3.6:27b.
It successfully completes long horizon tasks with OpenCode.
Apple caught off guard by AI demand for Mac Mini and Mac Studio. jckahn, Hacker News commenter, self-described, Aug 31, 2026. Qwen3.8 27B as Unsloth's Q3 XXS with 128k context on a Mac mini M4 24GB with OpenCode.
It takes about 2 hours to fill the context
Apple caught off guard by AI demand for Mac Mini and Mac Studio. SamInTheShell, Hacker News commenter, self-described, Aug 31, 2026. Qwen3.8 27B at Q4_K_S on a Radeon 7900 XTX at 50 tokens per second, with 128k context.
You get 260k context, ~150 token/s continuous performance, and full agentic capabilities
Local AI Is Dead. You Are at the Funeral. diablozzq, Hacker News commenter, self-described, Aug 31, 2026. Qwen3.8 27B Quasar NVFP4 on a single 5090 with the DeepSeek Harness, multi-hour autonomous runs.
my coding agents regularly reach 200k context used without noticeable degradation
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses. skolos, Hacker News commenter, self-described, Sep 8, 2026. Qwen3.8 27B NVFP4 with both weights and cache quantized on an RTX 5090, coding agents to 200k context.
I've run sessions in hax where it hit that cap multiple times and compressed the context down to 15% and continued with no problem
Pi 1.0. tingletech, Hacker News commenter, self-described, Oct 2, 2026. Qwen3.8 27B on llama-server at its default 262144 context in the hax harness.
the limit on context size is a huge issue for more serious work
I'm not paying $20 for ChatGPT or Claude because a free local LLM does. pllbnk, Hacker News commenter, self-described, Oct 7, 2026. Qwen3.8 27B on an M5 Pro with 48GB at about 10 tokens per second, and on an RTX 5090.
Running locally on 24GB VRAM, 160K context, 1200tok/sec (prefill) and 60tok/sec (gen)
Post by @AgiMan_WCL. Agi Man, X user, self-described, Oct 27, 2026. Qwen3.8 27B Q4_K_M running locally on 24GB VRAM at 160K context for C++20 work on a 1.3M-line codebase.
This is a hilarious default. It's absolutely not a good way to run the model, especially on consumer hardware.
Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things. Simon Willison, independent developer and blogger, self-described, Aug 16, 2026. Qwen3.8 27B as the 17GB Q4_K_M build in LM Studio on an M5 Max MacBook Pro and a DGX Spark.
Older builds fail with unknown model architecture: 'qwen35' . I hit this myself.
Run Qwen3.8 27B locally: real numbers from my Mac Studio. TerminalBytes, independent tech blog, self-described, Aug 27, 2026. Qwen3.8 27B as the Ollama Q4_K_M build on a Mac Studio M3 Ultra, five timed runs against qwen3.6:27b.
the effort setting matters a lot (note that the default is xhigh ) - and it is a tricky choice, as it can overthink
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses. Piotr Migdał, author on the Quesma blog, self-described, Aug 26, 2026. Qwen3.8 27B in BF16 and Unsloth Q8, Q4, Q2 and 1-bit quantizations on llama.cpp, GPQA Diamond, IFBench and Terminal-Bench 2.1.
The model itself (Qwen 3.8 27B specifically) can handle being interrupted just fine and i often interrupt it to clarify things
Five Qwen3.8-27B models match Fable 5 Using GVS5H Harness. badsectoracula, Hacker News commenter, self-described, Oct 25, 2026. Qwen3.8 27B with Unsloth UD-Q4_K_XL via llama.cpp at 131k context, interrupted mid-task.
only accepts `reasoning_effort ∈ {xhigh, medium, low}` and calls `raise_exception(...)` for anything else
Qwen3.8-27B chat template rejects Claude Code's default reasoning_effort="high" via vLLM → HTTP 500. EKKO-H, GitHub issue author, self-described, Aug 19, 2026. Qwen3.8-27B-AWQ-INT4 served with vLLM behind Claude Code 2.1.235.
it has a real overthinking issue
Post by @jun_song. Jun Song, X user, self-described, Aug 19, 2026. Qwen3.8-27B that the author is trying to fix with supervised fine-tuning and harness tweaks.
Qwen3.8 answered the same prompts in roughly 1,000 tokens where 3.6 rambled through 2,000-3,300
Run Qwen3.8 27B locally: real numbers from my Mac Studio. TerminalBytes, independent tech blog, self-described, Aug 27, 2026. Qwen3.8 27B as the Ollama Q4_K_M build on a Mac Studio M3 Ultra, five timed runs against qwen3.6:27b.
On OpenRouter, that would cost more than 10x what it actually costs me
Apple caught off guard by AI demand for Mac Mini and Mac Studio. randomblock1, Hacker News commenter, self-described, Aug 31, 2026. Qwen3.8 27B at Q4_K_M with 131K context on a 7900 XTX 24GB at 55 tokens per second with MTP.
This is a very efficient way to burn your money, but I would not recommend it for programming
Qwen 3.8 27B available on Cerebras at 1500 tokens/s. gpugreg, Hacker News commenter, self-described, Sep 3, 2026. Qwen3.8 27B hosted on Cerebras at 1500 tokens per second for a programming task.
it does a lot more testing attempts and burns a ton of tokens + compactions, so every task it takes 1.2-2x as long as 35b-a3b does
LFM2.5-24B-A2B: Built for fast on-device agents. eyegor, Hacker News commenter, self-described, Oct 15, 2026. dense Qwen3.8 27B against Qwen3.6 35b-a3b for agentic coding under 24GB VRAM.
Was that worth waiting 21 minutes for? Absolutely not.
Qwen 3.8 27B is excellent, but it defaults to wildly overthinking things. Simon Willison, independent developer and blogger, self-described, Aug 16, 2026. Qwen3.8 27B as the 17GB Q4_K_M build in LM Studio on an M5 Max MacBook Pro and a DGX Spark.
the new model generates at half the speed of its predecessor
Run Qwen3.8 27B locally: real numbers from my Mac Studio. TerminalBytes, independent tech blog, self-described, Aug 27, 2026. Qwen3.8 27B as the Ollama Q4_K_M build on a Mac Studio M3 Ultra, five timed runs against qwen3.6:27b.
I'm getting about 50-60 tokens/second
Qwen 3.8 27B. lelandbatey, Hacker News commenter, self-described, Aug 14, 2026. Qwen3.8 27B as the Unsloth 2-bit quant on a 5070ti with 16GB of VRAM at 128k context through llama.cpp.
this new dense model, Qwen 3.8 27B, gets ~4 tokens/second on generation
Qwen 3.8 27B. peri-cl, Hacker News commenter, self-described, Aug 14, 2026. Qwen3.8 27B UD-Q4_K_XL on CPU against Qwen3.6-35B-A3B on a laptop.
I can run it at 85-95 tokens per second on my personal PC
Norway should buy OpenAI. NorwegianDude, Hacker News commenter, self-described, Aug 18, 2026. Qwen3.8 27B on the author's personal PC at 85 to 95 tokens per second.
sglang, 150+ tok/s on a 5090 in ubuntu 26.04 via wsl
Why your local LLM feels dumber than it is. IronWolve, Hacker News commenter, self-described, Aug 22, 2026. Qwen3.8 27B NVFP4 on an RTX 5090 with SGLang in opencode, medium reasoning, 96k context.
the new Qwen3.8-27B model is actually slower with MTP on my M4 Max
Ornith-1.5: From Self-Scaffolding to Self-Improvement. jwr, Hacker News commenter, self-described, Aug 20, 2026. Qwen3.8 27B with multi-token prediction on an M4 Max.
Qwen3.8-27B runs at 59.5 tok/s on my M4 Max, 40-core GPU, 128 GB
Why your local LLM feels dumber than it is. asats, Hacker News commenter, self-described, Aug 23, 2026. Qwen3.8 27B on an M4 Max with a 40-core GPU and 128GB at 59.5 tokens per second.
you can get ~800 TPS token generation (c=8) and ~140 Tokens per second single stream
Why your local LLM feels dumber than it is. a11r, Hacker News commenter, self-described, Aug 23, 2026. a 4-bit quant of Qwen3.8 27B in the author's internal tests, on an RTX 5090 with ninfer.
it's difficult to run a dense model concurrently with high throughput
Qwen 3.8 27B available on Cerebras at 1500 tokens/s. gabri200, Hacker News commenter, self-described, Sep 4, 2026. Qwen3.8 27B under high concurrency with multi-token prediction.
200 tok/s generation for single stream, or 801 tok/s generation for 8 concurrent streams
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses. skolos, Hacker News commenter, self-described, Sep 8, 2026. Qwen3.8 27B NVFP4 with both weights and cache quantized on an RTX 5090, coding agents to 200k context.
the t/s is so low for me on my old M1 Max 64GB that I hope others are getting use out of it
Benchmarking Qwen3.8 27B quantizations: 4-bit holds up, 1-bit collapses. bellowsgulch, Hacker News commenter, self-described, Sep 8, 2026. Qwen3.8 27B on an old M1 Max 64GB.
I can run Qwen 3.8 27B (which is a REALLY capable model) in the background coding for me while I'm simultaneously browsing the web and playing VALORANT without any performance impact
Mistral X Mozilla: Private, Multilingual AI Browsing. redox99, Hacker News commenter, self-described, Sep 16, 2026. Qwen3.8 27B coding in the background on a six-year-old GPU while gaming and browsing.
27B thinks so much that it was honestly too painful
Xiaomi MiMo v2.6. girvo, Hacker News commenter, self-described, Sep 21, 2026. Qwen3.8 27B against Qwen 3.8 Flash Next on a GB10 box with the Pi harness.
I can get at most 40 tokens/second with 27B, but I get around 90 tokens/second with the MoE
Best LLM for every budget, updated daily. seanmcdirmid, Hacker News commenter, self-described, Sep 24, 2026. Qwen3.8 27B against Qwen 3.6 35b A3b on the author's machine at up to 40 tokens per second.
they take much more time than Opus due to the compounding effects of my slow GPU and Qwen's verbosity
Run Qwen 3.8 Flash Next (125B) on consumer hardware (RTX 4090) at 100T/s. stymaar, Hacker News commenter, self-described, Oct 4, 2026. Qwen3.8 27B for agentic coding against Opus 4.6, run at night on a slow GPU.
I am getting ~10 tok/s in M5 Pro with 48 GB with Qwen 3.8 27B. It's workable but very annoying
I'm not paying $20 for ChatGPT or Claude because a free local LLM does. pllbnk, Hacker News commenter, self-described, Oct 7, 2026. Qwen3.8 27B on an M5 Pro with 48GB at about 10 tokens per second, and on an RTX 5090.
anything moderately involved requires xhigh reasoning and it will spend literally tens of thousands of tokens turning over a problem
Llama.cpp on a jailbroken PS5: run any GGUF model natively on the console. thombles, Hacker News commenter, self-described, Oct 17, 2026. Qwen3.8 27B on a jailbroken PS5 at low tens of tokens per second, around Opus 4.6.
because its a dense model it is pretty slow to run and requires a lot of hardware
Show HN: Llmspeed – feel how fast a local LLM runs before you buy the hardware. PaulKeeble, Hacker News commenter, self-described, Oct 17, 2026. Qwen3.8-27B as a dense local model needing more than 24GB VRAM, against mixture-of-experts models.
the MTP variants of Qwen3.8-27B as consistently slower than the same quantization without MTP heads, on Apple Silicon
Qwen3.8-27B MTP variants are 2x slower than non-MTP on Apple Silicon - is this expected?. otsoa-dubief, GitHub issue author, self-described, Aug 15, 2026. Qwen3.8-27B multi-token-prediction quants against the same quant without heads on Apple Silicon.
qwen3.8 27b on my hardware runs slow as fuck so i wouldnt use any of these
Post by @G4mi_. Gami, X user, self-described, Oct 27, 2026. Qwen3.8 27B on the author's own hardware.
I've seen too much weirdness out of 4-bit quants since Qwen3.8 shipped
Qwen 3.8-Flash-Next releasing tomorrow (125B a6B). ekidd, Hacker News commenter, self-described, Aug 25, 2026. Qwen3.8 27B at various quant levels, 4-bit and above, in VRAM.
Qwen3.8-27B-4bit generally runs out of output token before completing the task though excellent partial results
My local model setup on an M4 Pro Mac Mini. akg_67, Hacker News commenter, self-described, Sep 2, 2026. Qwen3.8 27B as the 4-bit oMLX build on an M1 Max 32GB with the VSCode Cline extension, on a Django refactor.
On a hard problem the planner runs 32K tokens of reasoning and never writes the plan
Five Qwen3.8-27B models match Fable 5 Using GVS5H Harness. guregodevo, Hacker News commenter, self-described, Oct 25, 2026. Qwen3.8-27B as planner in a multi-role harness, and on Cerebras with thinking off.
temperature: 0`** | ⛔ **12/12 FAIL — the easiest way to reproduce this
Qwen3.8-27B: reasoning_effort="xhigh" (the default) returns an empty answer with finish_reason="stop" on ~17% of calls. TT-Dev1, GitHub issue author, self-described, Aug 19, 2026. Qwen3.8-27B served locally, default xhigh reasoning effort, about 1,000 test calls.
Qwen3.8-27B repeatedly emitted EOS immediately after a backtick character, truncating the response mid-sentence
Qwen3.8-27B: premature EOS right after a backtick in long-context thinking mode (SGLang with EAGLE spec decode). dollarser, GitHub issue author, self-described, Aug 19, 2026. Qwen3.8-27B on SGLang with EAGLE speculative decoding in a long agentic coding session at 152K to 154K context.
never returns a response for `qwen3.8:27b`
qwen3.8:27b: POST /v1/chat/completions never responds (works fine via /api/chat and ollama run). aikenmilk21, GitHub issue author, self-described, Aug 16, 2026. qwen3.8:27b on Ollama 0.32.13 in Docker on two AMD RX 6800-class GPUs.
it will run for around 20-30 then just give out
Qwen3.8:27B on Ollama + Claude Code setup having incomplete responses. ThinkerDesigns, GitHub issue author, self-described, Aug 23, 2026. Qwen3.8:27b on Ollama 0.32.15 with Claude Code 2.1.241.
llama-server dies silently (no assert, no error output, process exits) at ~520K tokens of prefill
Eval bug: Qwen3.8-27B (qwen35 hybrid) llama-server crashes silently at ~520K prefill tokens with YaRN rope-scale 4. asaffulks, GitHub issue author, self-described, Aug 14, 2026. Qwen3.8-27B UD-Q8_K_XL on llama-server b10434 on an RTX PRO 6000 with YaRN rope scaling to extend context.
can desync XGrammar and emit 250k trailing spaces with HTTP 200
[Bug]: Qwen3.8 + DSpark + streaming json_schema can desync XGrammar and emit 250k trailing spaces with HTTP 200. hr168, GitHub issue author, self-described, Sep 4, 2026. Qwen3.8 27B served with vLLM 0.27.1 on an RTX PRO 6000 with DSpark and streaming json_schema.