mirror of
https://github.com/NVIDIA/Model-Optimizer.git
synced 2026-10-30 07:34:44 +08:00
Shengliang Xu
7144482166
### What does this PR do? Add documentation for several hf_ptq.py functionalities that were missing from the PTQ README: - Recipe-based quantization (--recipe): declarative YAML alternative to --qformat for specifying full quantization configuration - KV cache quantization (--kv_cache_qformat): all 8 format choices with usage examples and descriptions - AutoQuantize advanced options: --auto_quantize_method (gradient/kl_div), --auto_quantize_score_size, and --auto_quantize_checkpoint - Expanded supported QFORMAT list from 8 to all 19 available formats - Added simple_eval to the valid tasks list - Clarified that kl_div AutoQuantize method does not require backpropagation <!-- This is an auto-generated comment: release notes by coderabbit.ai --> ## Summary by CodeRabbit * **Documentation** * Updated quantization format documentation with supported options and usage examples. * Added recipe-based quantization guidance with YAML configuration and precedence details. * Expanded KV cache quantization documentation with available formats and configuration options. * Enhanced AutoQuantize documentation with advanced options and clarified method-specific requirements. <!-- end of auto-generated comment: release notes by coderabbit.ai --> --------- Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>