Chenjie Luo
ce8ce2229c
[NVBUG: 5617733] Update LLM generate API for modelopt LLM eval ( #498 )
...
## What does this PR do?
**Type of change:** ? Bug fix
**Overview:** ?
1) Remove kv_cache_config in the generate API. It's no longer used in
the code as well. We just estimate KV cache usage from other parameters
2) Add max_seq_len in the generate API to better estimate the real KV
cache usage.
3) Assume default lm_eval max input sequence length to be 4096
Signed-off-by: Chenjie Luo <chenjiel@nvidia.com >
2025-11-04 11:08:03 -08:00
146d1d9d40
Deprecate TRTLLM-build in examples ( #297 )
...
Signed-off-by: Chenjie Luo <chenjiel@nvidia.com >
Signed-off-by: Chenjie Luo <108829653+cjluo-nv@users.noreply.github.com >
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com >
Co-authored-by: Chenjie Luo <chenjie@omniml.ai >
Co-authored-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com >
2025-09-18 03:22:37 +05:30
Keval Morabia
103b1bb137
Push latest changes
...
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com >
2025-09-04 11:02:58 +05:30
Keval Morabia
1ef1d72a1b
Code quality improvements - typos, formatting, etc.
...
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com >
2025-09-02 19:58:33 +05:30
Keval Morabia
d09c82779c
Push latest changes and bug fixes ( #274 )
...
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com >
2025-08-29 17:29:52 +05:30
Keval Morabia
dcdc2df084
Push latest changes
...
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com >
2025-08-26 01:12:26 +05:30
Keval Morabia
37085354c9
Update files on Github ( #258 )
...
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com >
2025-08-17 02:44:16 +05:30
Keval Morabia
cafa7f60ed
Update for 0.33.0 release
2025-07-14 23:08:26 +05:30
Keval Morabia
7af33d29ce
Update for 0.31.0 release
2025-06-05 13:24:07 -07:00
Keval Morabia
7a047435ae
Update for 0.29.0 release
2025-05-08 23:43:51 +05:30
Keval Morabia
2017cd9063
Update for 0.25.0 release
2025-03-03 22:54:22 +05:30
Keval Morabia
73d6af785f
Update 0.23.0 - OSS release
2025-01-29 01:45:47 +05:30
Chenjie Luo