Skip to content

#ggml.q6_k encoding

← Encoding reference

GGML Q6_K super-block storage schema.

Property Value
Role storage schema
Implicit shaped attachment no

Fixed storage geometry

Logical elements Storage bytes Required alignment
256 210 2

Logical fields

Role Level Format Elements Bits per element
payload 0 quant_i6 256 6
scale 0 f16 1 16
scale 1 i8 16 8

Bit projections

Field Record bit offset Record bit stride Field element offset Elements Field bit offset Bits
payload[0] 0 8 0 32 0 4
payload[0] 256 8 32 32 0 4
payload[0] 4 8 64 32 0 4
payload[0] 260 8 96 32 0 4
payload[0] 512 8 128 32 0 4
payload[0] 768 8 160 32 0 4
payload[0] 516 8 192 32 0 4
payload[0] 772 8 224 32 0 4
payload[0] 1024 8 0 32 4 2
payload[0] 1026 8 32 32 4 2
payload[0] 1028 8 64 32 4 2
payload[0] 1030 8 96 32 4 2
payload[0] 1280 8 128 32 4 2
payload[0] 1282 8 160 32 4 2
payload[0] 1284 8 192 32 4 2
payload[0] 1286 8 224 32 4 2
scale[0] 1664 16 0 1 0 16
scale[1] 1536 8 0 16 0 8

Required auxiliary values

Key Description
scale —
secondary_scale —