KurisandLeiWang1999 719d23dce5 feat: auto-vectorize bf16/fp16 reduce with packed add2 intrinsics (#2112) ...

* fix: add missing TvmLogDebugSettings::ParseSpec and VerboseEnabledImpl for TVM_LOG_CUSTOMIZE builds

When TVM_LOG_CUSTOMIZE=1, TVM's logging.cc skips compiling
TvmLogDebugSettings::ParseSpec and VerboseEnabledImpl (guarded by
#if TVM_LOG_CUSTOMIZE == 0). However libtilelang.so calls these
functions via the inline FromFlag(), causing a runtime symbol
lookup error. Add the missing implementations to tilelang's own
logging.cc.

* feat: auto-vectorize bf16/fp16 reduce with packed add2 intrinsics

* style: clang-format

* fix: fp16 batch pack — fix Shuffle codegen taking address of temporary

- Add tl::pack_half2 helper in common.h that returns uint1, avoiding taking
  address of a temporary __pack_half2 return value
- Update ShuffleNode codegen for fp16x2 to use pack_half2 instead of
  &(__pack_half2(...))
- Re-enable fp16 batch pack (remove bf16-only restriction in can_batch_pack)
- Add SumOp_fp16x2/MaxOp_fp16x2/MinOp_fp16x2 packed reducer structs

* refactor: simplify reduce packing API

- Replace ReducePackConfig with simple GetPreferedVectorizedSize(DataType, Target) -> int
- Merge getBatchReducerSuffix into MakeCodegenReducer(vsize)
- MakeReduce(vsize, acc, b) -> optional<PrimExpr>
- MakeInitValue(vsize) handles Broadcast internally
- Guard nan_propagate in MakeCodegenReducer vsize>1 path (no packed nan ops exist)

* fix: guard nan_propagate in MakeReduce packed path, mirror scalar structure

* feat: support nan_propagate in packed reduce (max2_nan/min2_nan)

* fix: add bitwise reduce ops to MakeReduce vsize=1 path

* fix lint error

---------

Co-authored-by: LeiWang1999 <leiwang1999@outlook.com>

2026-05-19 15:03:44 +08:00

..

test_tilelang_intimm.py

[Lint] Phaseout Yapf format and embrace ruff format (#1417)

2025-12-12 17:22:18 +08:00

test_tilelang_language_access_ptr_codegen.py

[CUDA] Support int4 T.gemm (#2063)

2026-04-20 16:35:43 +08:00

test_tilelang_language_access_ptr.py

[Refactor] Introduce T.access_of to combine T.address_of and access_ptr (#1827)

2026-02-11 22:51:59 +08:00

test_tilelang_language_alias.py

[Bugfix] Open Rocm ci test and fix some bugs. (#1443)

2026-01-06 02:18:29 +08:00

test_tilelang_language_all_of.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00

test_tilelang_language_alloc_var_cmp.py

[Bugfix] Fix alloc_var re-bind warning when assigned with comparison ops (#1974)

2026-03-27 11:17:21 +08:00

test_tilelang_language_alloc.py

[Feature] Support alloc global workspace (#1940)

2026-03-23 19:26:24 +08:00

test_tilelang_language_annot.py

[Bugfix] Open Rocm ci test and fix some bugs. (#1443)

2026-01-06 02:18:29 +08:00

test_tilelang_language_annotate_safe_value.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00

test_tilelang_language_any_of.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00

test_tilelang_language_assume.py

[Enhancement] Update examples and tests for improved type handling functionality (#1448)

2025-12-17 14:41:25 +08:00

test_tilelang_language_async_copy_gemm_sm80.py

[Refactor] Improve cp.async lowering and add async_copy op (#1887)

2026-03-06 17:35:16 +08:00

test_tilelang_language_atom_mma.py

[Refactor] Refactor multiple TensorCoreIntrinEmitter to provide atom-level mma control interface (#2161)

2026-05-09 16:04:31 +08:00

test_tilelang_language_atomic.py

[ROCm] Try to fix ROCm CI error (#2179)

2026-05-12 15:13:34 +08:00

test_tilelang_language_augassign.py

[Bugfix] Fix ast builder error for value -= 1 (#1825)

2026-02-09 17:30:22 +08:00

test_tilelang_language_ceildiv.py

[Enhancement] Update examples and tests for improved type handling functionality (#1448)

2025-12-17 14:41:25 +08:00

test_tilelang_language_chain_equal.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00

test_tilelang_language_clamp.py

[Enhancement] Update examples and tests for improved type handling functionality (#1448)

2025-12-17 14:41:25 +08:00

test_tilelang_language_clear.py

[Refactor] Phaseout legacy util map_torch_type with T.dtype.as_torch (#2075)

2026-04-21 18:27:15 +08:00

test_tilelang_language_cluster.py

[Feature][Example] Introduce CLC tile schedule and add example for sm100 GEMM (#2029)

2026-04-17 15:19:04 +08:00

test_tilelang_language_composable_index.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00

test_tilelang_language_cooperative.py

[Fix] Add register to read A ptr in test_tilelang_language_cooperative.py (#1593)

2026-01-04 15:45:38 +08:00

test_tilelang_language_copy.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00

test_tilelang_language_cumsum.py

test: reduce CI runtime for slow Python suites (#1932)

2026-03-18 13:08:30 +08:00

test_tilelang_language_dtype_as_torch.py

Fix float4 storage dtype torch mapping (#2174)

2026-05-10 21:50:30 +08:00

test_tilelang_language_eager_jit.py

test: reduce CI runtime for slow Python suites (#1932)

2026-03-18 13:08:30 +08:00

test_tilelang_language_frontend_v2.py

test: reduce CI runtime for slow Python suites (#1932)

2026-03-18 13:08:30 +08:00

test_tilelang_language_func_attrs.py

[Feature] Support T.annotate_compile_flags, T.annotate_pass_configs, and out_idx as PrimFunc attrs (#2006)

2026-04-02 12:42:47 +08:00

test_tilelang_language_get_warp_info.py

[Enhancement] Update examples and tests for improved type handling functionality (#1448)

2025-12-17 14:41:25 +08:00

test_tilelang_language_if_range.py

[Refactor] Remove GEMM v1 and promote gemm_py to be the canonical gemm op (#2033)

2026-04-13 12:42:44 +08:00

test_tilelang_language_infinity.py

[Bugfix] Open Rocm ci test and fix some bugs. (#1443)

2026-01-06 02:18:29 +08:00

test_tilelang_language_int64.py

[Feature] Add full Windows support and fix related cross-platform issues (#2093)

2026-05-06 23:08:24 +08:00

test_tilelang_language_intrinsics_codegen.py

[Enhancement] Update examples and tests for improved type handling functionality (#1448)

2025-12-17 14:41:25 +08:00

test_tilelang_language_isfinite_codegen.py

[Feature] Add CUDA intrinsic for isfinite operation (#1925)

2026-03-12 17:21:01 +08:00

test_tilelang_language_ldg.py

[Refactor] Unify the usage of cast-related operators (#1757)

2026-02-02 18:47:18 +08:00

test_tilelang_language_let_layout.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00

test_tilelang_language_let.py

[FFI] Remove upper version bound on apache-tvm-ffi (#2071)

2026-04-21 18:09:24 +08:00

test_tilelang_language_mask_op.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00

test_tilelang_language_min_blocks_per_sm.py

[Refactor] Remove GEMM v1 and promote gemm_py to be the canonical gemm op (#2033)

2026-04-13 12:42:44 +08:00

test_tilelang_language_negative_index.py

[Enhancement] Update examples and tests for improved type handling functionality (#1448)

2025-12-17 14:41:25 +08:00

test_tilelang_language_parallel.py

test: reduce CI runtime for slow Python suites (#1932)

2026-03-18 13:08:30 +08:00

test_tilelang_language_pdl.py

[Bugfix] Fix pdl related intrin handling to avoid strict annotation codegen (#1650)

2026-01-09 17:31:33 +08:00

test_tilelang_language_pipeline.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00

test_tilelang_language_ptr.py

[Refactor] Phaseout legacy util map_torch_type with T.dtype.as_torch (#2075)

2026-04-21 18:27:15 +08:00

test_tilelang_language_rand.py

[BugFix] Stride check and fix for tensors with zero-stride argument (#1749)

2026-01-29 23:59:24 +08:00

test_tilelang_language_reduce_maxmin_nan.py

Nan propagation option for bf16 and half16 (#1958)

2026-04-13 16:18:24 +08:00

test_tilelang_language_reduce.py

feat: auto-vectorize bf16/fp16 reduce with packed add2 intrinsics (#2112)

2026-05-19 15:03:44 +08:00

test_tilelang_language_reshape.py

[Refactor] Move backend-specific GEMM implementations and transforms into backend directories (#2165)

2026-05-08 17:11:34 +08:00

test_tilelang_language_select.py

[Refactor] Unify the usage of cast-related operators (#1757)

2026-02-02 18:47:18 +08:00

test_tilelang_language_source_kernel.py

[Feature] Introduce T.CUDASourceCodeKernel (#1970)

2026-04-17 16:48:28 +08:00

test_tilelang_language_stg.py

[Refactor] Unify the usage of cast-related operators (#1757)

2026-02-02 18:47:18 +08:00

test_tilelang_language_subtype.py

[Bugfix][Subtype] Fix scalar fp4 store/load codegen for non-packed buffers (#2037)

2026-04-14 15:54:28 +08:00

test_tilelang_language_sync_threads.py

Allow variable barrier id in T.sync_threads() (#2197)

2026-05-18 14:50:43 +08:00

test_tilelang_language_tcgen05_gemm.py

[Feature] Add full Windows support and fix related cross-platform issues (#2093)

2026-05-06 23:08:24 +08:00

test_tilelang_language_ternary.py

[Enhancement] Update examples and tests for improved type handling functionality (#1448)

2025-12-17 14:41:25 +08:00

test_tilelang_language_tma_1d.py

[Enhancement] Update examples and tests for improved type handling functionality (#1448)

2025-12-17 14:41:25 +08:00

test_tilelang_language_tma_copy.py

[TMA] Support FP4 TensorMap TMA copies (#2107)

2026-04-28 12:35:16 +08:00

test_tilelang_language_tma_store.py

[codex] Fix 1D TMA store layout inference (#2137)

2026-05-03 23:57:20 +08:00

test_tilelang_language_transpose.py

[Feature] Add full Windows support and fix related cross-platform issues (#2093)

2026-05-06 23:08:24 +08:00

test_tilelang_language_unroll.py

[Enhancement] Improve unroll loop functionality for dynamic extent and corresponding test case (#1654)

2026-01-12 22:33:17 +08:00

test_tilelang_language_var_init.py

[Bugfix] Open Rocm ci test and fix some bugs. (#1443)

2026-01-06 02:18:29 +08:00

test_tilelang_language_vectorize.py

[Refactor] Move backend-specific GEMM implementations and transforms into backend directories (#2165)

2026-05-08 17:11:34 +08:00

test_tilelang_language_vectorized_cast.py

[BugFix] Fix FP4 related vectorized cast (#1741)

2026-01-27 20:54:40 +08:00

test_tilelang_language_view.py

[Bugfix] Fix stage-expanded annotated-layout aliases in LayoutInference (#2031)

2026-04-17 17:22:54 +08:00

test_tilelang_language_warp_reduce.py

[Enhancement] Update examples and tests for improved type handling functionality (#1448)

2025-12-17 14:41:25 +08:00

test_tilelang_language_warp_sync.py

[API] Default warp-lane mask to 0xFFFFFFFF for warp-sync builtins (#2039)

2026-04-14 01:05:54 +08:00

test_tilelang_language_warp_vote.py

[API] Default warp-lane mask to 0xFFFFFFFF for warp-sync builtins (#2039)

2026-04-14 01:05:54 +08:00

test_tilelang_language_wgmma_gemm.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00

test_tilelang_memory_leak.py

[Refactor][Pipeline] Run pipeline rewriting before layout inference and stabilize tiled WS (#2002)

2026-04-07 23:54:55 +08:00