QwenDenseApache 2.0

Qwen 3.5 27B

Qwen 3.5 27B is the dense flagship of the Qwen 3.5 hybrid architecture family. At 27B parameters with only 25% of layers using full KV-cache attention, it handles 262K contexts with dramatically less memory than traditional architectures. D

27.0B

Parameters

256K

Max Context

Dense

Architecture

Feb 18, 2026

Released

Text

Modality

About Qwen 3.5 27B

Qwen 3.5 27B is the dense flagship of the Qwen 3.5 hybrid architecture family. At 27B parameters with only 25% of layers using full KV-cache attention, it handles 262K contexts with dramatically less memory than traditional architectures. Delivers quality approaching dense 70B models while fitting comfortably on 24 GB GPUs at Q4_K_M (~15 GB for weights + minimal KV cache). The Gated DeltaNet hybrid approach represents the future direction of efficient long-context LLMs. Apache 2.0.

Long ContextCodeReasoningAgenticCommercial

Technical Specifications

Total Parameters27.0B
ArchitectureDense
Attention TypeHybrid Gated DeltaNet + Full Attention (25% layers)
Hidden Dimensiond = 5,120
Transformer Layers16
Attention Heads24
KV Headsn_kv = 4
Head Dimensiond_head = 256
Activation FunctionSwiGLU
NormalizationRMSNorm
Position EmbeddingDual RoPE (local + global)

System Requirements

Estimated VRAM at 10% overhead for different quantization methods and context sizes.

Quantization1K ctx195K ctx256K ctx
Q4_K_M0.50 B/W
~97% of FP16
14.02Consumer GPU
26.16Datacenter GPU
29.96Datacenter GPU
Q8_01.00 B/W
~100% of FP16
27.97Datacenter GPU
40.12Datacenter GPU
43.91Datacenter GPU
F162.00 B/W
Reference
55.89Datacenter GPU
68.03Datacenter GPU
71.82Datacenter GPU
Fits 24 GB consumer GPU
Fits 80 GB datacenter GPU
Requires cluster / multi-GPU

Other Qwen Models

View All

Find the right GPU for Qwen 3.5 27B

Use the interactive VRAM Calculator to see exactly how much memory you need at any quantization level, context length, and overhead setting.