Skip to content

#ggml.q4_0 encoding

← Encoding reference

GGML Q4_0 block storage schema.

Property Value
Role storage schema
Implicit shaped attachment no

Fixed storage geometry

Logical elements Storage bytes Required alignment
32 18 2

Logical fields

Role Level Format Elements Bits per element
scale 0 f16 1 16
payload 0 quant_i4 32 4

Bit projections

Field Record bit offset Record bit stride Field element offset Elements Field bit offset Bits
scale[0] 0 16 0 1 0 16
payload[0] 16 8 0 16 0 4
payload[0] 20 8 16 16 0 4

Required auxiliary values

Key Description
scale —