跳转至

smooth_quant Configuration Reference

1. Configuration Overview

SmoothQuant smooth quantization processor configuration.

Item Content
Config Class SmoothQuantProcessorConfig
Source processor.py

2. Parameter List

2.1 SmoothQuantProcessorConfig

Field Path Type Required/Optional Default Value Range or Format Description Referenced Config
type string Optional smooth_quant smooth_quant Processor type, fixed to smooth_quant. None
alpha float Optional 0.5 — Smooth migration strength (0-1); a larger value migrates more activation outliers to the weights. None
symmetric bool Optional true — Whether to use symmetric quantization; affects the symmetry of the quantized result after smoothing. None
include list[string] / null Optional null — Module name patterns to include; if unset, all modules match. None
exclude list[string] / null Optional null — Module name patterns to exclude; takes precedence over include. None

Configuration Constraints

  • None.

3. Complete Configuration Reference

apiversion: modelslim_v1
spec:
  process:
  - type: smooth_quant
    alpha: 0.5
    symmetric: true