mirror of
https://github.com/tile-ai/tilelang.git
synced 2026-10-21 06:40:23 +08:00
Lei Wang
465c6c5e8c
* [Refactor] Remove unsupported tl_gemm and tl_gemm_sp operations * Removed references to tl_gemm and tl_gemm_sp from various files, including code generation and built-in definitions, as these operations are currently unsupported. * Updated related comments and diagnostics to reflect the removal of these operations, ensuring clarity in the codebase. * This change simplifies the handling of unsupported operations and improves overall code maintainability. * Reduce CUDA template include overhead * Fix CUDA reduce fast min max helpers * lint fix * Fix CUDA swizzle ceil div helper * Restore CUDA wait_wgmma intrinsic helper * Fix CUDA cython TMA host adapter include * Remove unnecessary check for Cutlass fast math header in CUDA code generation * Update LibraryGenerator to correctly handle CUDA gencode flags for shared-library compilation, ensuring compatibility with target architecture and avoiding Hopper-only instruction issues. * Refactor smem_ptr_to_uint function to use __cvta_generic_to_shared for improved clarity and performance. * Refactor example scripts and CUDA math intrinsics for improved performance and clarity - Updated `example_dequant_gemm_fp4_hopper.py` to directly call `run_regression_perf()` and print latency, removing unused argument parsing code. - Modified `example_topk.py` to specify the backend as "cupti" in the benchmarking function. - Enhanced CUDA code generation by introducing `RequiresTileLangMathHeader` to manage math header dependencies for specific functions. - Updated barrier operations in `barrier.h` to use the correct syntax for shared memory barriers. - Improved testing for bfloat16 math intrinsics by replacing pytest skips with decorators for CUDA availability checks. * Refactor CUDA code for improved readability and consistency - Reformatted the `RequiresTileLangMathHeader` function for better readability. - Updated assembly syntax in `barrier.h` for clarity and consistency. - Cleaned up whitespace in the bfloat16 math intrinsics test file to enhance code cleanliness. * Remove unnecessary whitespace in CUDA code for improved readability * Add TileLang intrinsic for prefetching TMA descriptor - Introduced `prefetch_tma_descriptor` intrinsic in C++ and updated relevant files to use `call_intrin` instead of `call_extern`. - Updated CUDA code generation to handle the new intrinsic correctly. - Modified tests to ensure the new intrinsic is called appropriately and that no `call_extern` is used for internal TileLang operations. - Enhanced documentation in SKILL.md regarding the addition of new TileLang intrinsics. * Add bfloat16 hexp overload and update common.h for compatibility - Introduced `hexp` overload for `bfloat16_t` in `common.h` to bridge TileLang and CUDA's handling of exponential functions. - Updated tests to verify the presence of the new `hexp` definition in `common.h`. - Enhanced CUDA code generation to support the new intrinsic for better performance and compatibility. * Update common.h for CUDA compatibility with aligned double4 types - Adjusted preprocessor condition in `common.h` to maintain compatibility with CUDA versions prior to 13 by ensuring proper definition of aligned double4 types. - This change enhances the compatibility of the code with older NVRTC built-in vector headers.