PracticeConfig Configuration Reference¶
1. Configuration Overview¶
Complete best-practice quantization task configuration: metadata + task (task ≡ apiversion + spec).
| Item | Content |
|---|---|
| Config Class | PracticeConfig |
| Source | interface.py |
2. Parameter List¶
2.1 PracticeConfig
| Field Path | Type | Required/Optional | Default | Value Range or Format | Description | Referenced Config |
|---|---|---|---|---|---|---|
metadata |
object |
Optional | See the nested configuration default | — | Quantization configuration metadata (config_id/score/label/verified_*) | This page §2.2 |
task |
object |
Optional | See the nested configuration default | — | Quantization task description (apiversion + spec) | This page §2.3 |
Configuration Constraints
- Preprocessing: the old format {apiversion, metadata, spec, ...} becomes {metadata, task:{apiversion, spec, ...}}.
- Strips the aggregated task. prefix so that error paths match the spec. paths in the YAML.
2.2 Metadata
Metadata describing a quantization configuration; the label and scenario fields index it for the best-practice library.
| Field Path | Type | Required/Optional | Default | Value Range or Format | Description | Referenced Config |
|---|---|---|---|---|---|---|
config_id |
string |
Optional | Unknown |
— | Quantization configuration ID, for example 'Qwen3-32B W8A8' | None |
score |
float |
Optional | 100.0 |
— | Quantization configuration score, used for sorting; must be >= 0 | None |
label |
object |
Optional | {} |
— | Quantization configuration labels, used for filtering, for example: w_bit (int, weight quantization bit width), a_bit (int, activation quantization bit width), is_sparse (bool, whether sparse quantization is used), kv_cache (bool, whether KV Cache quantization is enabled), fa_quant (bool, whether FA quantization is enabled), fa_bit (int, FA quantization bit width) |
None |
verified_model_types |
list[string] |
Optional | [] |
— | List of verified model types, for example ['LLaMa3.1-70B', 'Qwen2.5-72B'] | None |
verified_tags |
object |
Optional | {} |
— | Verified scenario tags: keys are model types, values are lists of scenario tags (each scenario is a set of tags, such as ['MindIE','Atlas_A2_Inference']) | None |
Configuration Constraints
- None.
2.3 BaseQuantConfig
Derived Classes
| Config Class | Description | Document |
|---|---|---|
ModelslimV1QuantConfig |
modelslim_v1 quantization task configuration, located at the YAML root. |
modelslim_v1 Configuration Reference |
ModelslimConvertQuantConfig |
modelslim_convert quantization (weight conversion) task configuration, located at the YAML root. |
modelslim_convert Configuration Reference |
3. Complete Configuration Reference¶
metadata:
config_id: Qwen3-32B W8A8
label:
w_bit: 8
a_bit: 8
is_sparse: false
kv_cache: false
verified_model_types:
- Qwen3-32B
task:
apiversion: modelslim_v1
spec:
process:
- type: linear_quant
qconfig:
act:
dtype: int8
scope: per_tensor
symmetric: false
method: minmax
weight:
dtype: int8
scope: per_channel
symmetric: true
method: minmax
include:
- '*'
exclude: []
save:
- type: ascendv1_saver
part_file_size: 4
dataset: mix_calib.jsonl