mirror of
https://github.com/tile-ai/tilelang.git
synced 2026-10-22 06:50:25 +08:00
Lei WangandZhiwen Mo
bea40bdd0e
* fp4 related update, require_cu13 * Enhance CUDA type conversion handling and optimize dtype management - Updated CUDA vectorized cast functions to ensure proper handling of float16, float32, bfloat16, and float8 conversions, adding checks for bit sizes. - Refactored dtype conversion logic in `cuda_fp4.h` to utilize `cudaRoundZero` for improved accuracy in floating-point conversions. - Introduced a new method in `KernelParam` to convert TVM DataType to TileLang dtype. - Adjusted argument binding logic in `arg_binder.cc` to allow for better subtype matching based on total bit counts. - Enhanced dtype handling in `dtypes.py` to accommodate new float4_e2m1fn types and ensure compatibility with PyTorch. This update aims to improve type safety and conversion accuracy across the codebase. * lint fix * lint fix * typo fix --------- Co-authored-by: Zhiwen Mo <zm125@ic.ac.uk>