smooth_quant Configuration Reference¶
1. Configuration Overview¶
SmoothQuant smooth quantization processor configuration.
| Item | Content |
|---|---|
| Config Class | SmoothQuantProcessorConfig |
| Source | processor.py |
2. Parameter List¶
2.1 SmoothQuantProcessorConfig
| Field Path | Type | Required/Optional | Default | Value Range or Format | Description | Referenced Config |
|---|---|---|---|---|---|---|
type |
string |
Optional | smooth_quant |
smooth_quant |
Processor type, fixed to smooth_quant. |
None |
alpha |
float |
Optional | 0.5 |
— | Smooth migration strength (0-1); a larger value migrates more activation outliers to the weights. | None |
symmetric |
bool |
Optional | true |
— | Whether to use symmetric quantization; affects the symmetry of the quantized result after smoothing. | None |
include |
list[string] / null |
Optional | null |
— | Module name patterns to include; if unset, all modules match. | None |
exclude |
list[string] / null |
Optional | null |
— | Module name patterns to exclude; takes precedence over include. |
None |
Configuration Constraints
- None.