跳转至

binary_analysis Configuration Reference

1. Configuration Overview

Binary (quantized/non-quantized) sensitivity analysis processor configuration.

Item Content
Config Class BinaryAnalysisProcessorConfig
Source processor.py

2. Parameter List

2.1 BinaryAnalysisProcessorConfig

Field Path Type Required/Optional Default Value Range or Format Description Referenced Config
type string Optional binary_analysis binary_analysis Processor type, fixed to binary_analysis. None
metrics string Optional mse — Analysis metric: mse (mean squared error) None
patterns list[string] Optional ['*'] — List of layer name patterns to analyze; the default * matches all None
configs list[object] Optional [] — List of quantization sub-processor configurations used to run the quantize-dequantize path This page §2.2

Configuration Constraints

  • None.

2.2 AutoProcessorConfig

Derived Classes

Config Class type Description Document
AdaptRotationProcessorConfig adapt_rotation Adaptive rotation (adapt_rotation) processor configuration. adapt_rotation Configuration Reference
AutoroundProcessorConfig autoround_quant AutoRound quantization processor configuration. autoround_quant Configuration Reference
AWQProcessorConfig awq AWQ (Activation-aware Weight Quantization) processor configuration. awq Configuration Reference
BinaryAnalysisProcessorConfig binary_analysis Binary (quantized/non-quantized) sensitivity analysis processor configuration. This page §2.1
BinaryOperatorLayerWiseProcessorConfig binary_operator_layer_wise Layer-wise sensitivity analysis processor configuration (compares per-block floating-point and quantized outputs). binary_operator_layer_wise Configuration Reference
BinaryOperatorModelWiseProcessorConfig binary_operator_model_wise Model-level sensitivity analysis configuration (compares final model outputs, using the MSE metric) binary_operator_model_wise Configuration Reference
DynamicCacheProcessorConfig dynamic_cache KV cache quantization processor configuration. dynamic_cache Configuration Reference
FA3QuantProcessorConfig fa3_quant FA3 (FlashAttention-3) quantization processor configuration. fa3_quant Configuration Reference
FlatQuantProcessorConfig flatquant FlatQuant processor configuration: defines quantization training parameters, strategy, mixed precision, and more flatquant Configuration Reference
FlexAWQSSZProcessorConfig flex_awq_ssz Flex AWQ SSZ outlier suppression processor configuration. flex_awq_ssz Configuration Reference
FlexSmoothQuantProcessorConfig flex_smooth_quant FlexSmoothQuant smooth quantization processor configuration. flex_smooth_quant Configuration Reference
FloatSparseProcessorConfig float_sparse Floating-point sparsity processor configuration. float_sparse Configuration Reference
GroupProcessorConfig group Processor combiner configuration. group Configuration Reference
IterSmoothProcessorConfig iter_smooth Iterative smooth (IterativeSmooth) processor configuration. iter_smooth Configuration Reference
KVSmoothProcessorConfig kv_smooth KV cache smoothing processor configuration. kv_smooth Configuration Reference
LinearProcessorConfig linear_quant Linear layer quantization processor configuration. linear_quant Configuration Reference
LoadProcessorConfig load Module load/unload processor configuration. load Configuration Reference
OASQProcessorConfig oasq OASQ (Outlier-Aware Smooth Quantization) processor configuration. oasq Configuration Reference
OnlineQuaRotProcessorConfig online_quarot Online QuaRot rotation processor configuration. online_quarot Configuration Reference
QuaRotProcessorConfig quarot QuaRot (offline rotation) processor configuration. quarot Configuration Reference
QuantSaveProcessorConfig saver Unified save processor configuration. saver Configuration Reference
SmoothQuantProcessorConfig smooth_quant SmoothQuant smooth quantization processor configuration. smooth_quant Configuration Reference
SVDResidualProcessorConfig svd_res SVD residual (low-rank compensation) processor configuration. svd_res Configuration Reference
TrainableLinearQuantProcessorConfig trainable_linear_quant Trainable linear quantization (TLQ) processor configuration. trainable_linear_quant Configuration Reference
UnaryAnalysisProcessorConfig unary_analysis Unary (non-quantized) sensitivity analysis processor configuration. unary_analysis Configuration Reference

3. Complete Configuration Reference

apiversion: modelslim_v1
spec:
  process:
  - type: binary_analysis
    metrics: mse
    patterns:
    - '*'
    configs: []