trending/Model-Optimizer
1
0
Fork 0
mirror of https://github.com/NVIDIA/Model-Optimizer.git synced 2026-11-09 09:14:17 +08:00
Code Issues Packages Projects Releases Wiki Activity
240 Commits 468 Branches 62 Tags
fc92e98fe9635b5380140ddbd2a7efa80e46ab81
Commit Graph
29 Commits
Author SHA1 Message Date
Izzy PuttermanandKeval Morabia 5adb9ba0fc Add Spec dec Bench example (#474) 
## What does this PR do?

**Type of change:** New feature <!-- Use one of the following: Bug fix,
new feature, new example, new tests, documentation. -->

**Overview:** Specdec bench example

## Usage
<!-- You can potentially add a usage example below. -->

```python
# Add a code snippet demonstrating how to use this
```

## Testing
<!-- Mention how have you tested your change if applicable. -->

## Before your PR is "*Ready for review*"
<!-- If you haven't finished some of the above items you can still open
`Draft` PR. -->

- **Make sure you read and follow [Contributor
guidelines](https://github.com/NVIDIA/TensorRT-Model-Optimizer/blob/main/CONTRIBUTING.md)**
and your commits are signed.
- **Is this change backward compatible?**: Yes <!--- If No, explain why.
-->
- **Did you write any new necessary tests?**: No
- **Did you add or update any necessary documentation?**: Yes
- **Did you update
[Changelog](https://github.com/NVIDIA/TensorRT-Model-Optimizer/blob/main/CHANGELOG.rst)?**:
Yes <!--- Only for new features, API changes, critical bug fixes or bw
breaking changes. -->

## Additional Information
<!-- E.g. related issue. -->

---------

Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
Co-authored-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-11-06 21:21:26 +00:00
Keval Morabia 90b1e68fcf Update HF nvidia collection links in docs (#475) 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-10-28 22:23:01 +05:30
Keval Morabia 547be00ace Fix LICENSE pre-commit hook 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-10-27 11:16:14 -07:00
h-guo18 ff8a1ed126 fix:eagle3 offline (#456) 
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-10-21 14:01:47 -07:00
h-guo18 40a7d243c3 [Eagle Offline] multinode support for hidden states dumper (#422) 
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-10-10 15:58:22 -07:00
h-guo18 557633c986 Fix: supporting gpt-oss HF eagle (#398) 
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-10-09 01:14:00 +00:00
h-guo18 abed33c3f8 Feat: TRTLLM Dumper for Eagle Offline Training (#404) 
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-10-07 20:24:14 -07:00
h-guo18 c55bcf0ab8 fix: eagle3 quantized base model (#383) 
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-09-29 18:30:26 -07:00
h-guo18 615f3c01f1 Efficient Eagle3 training with eagle KV cache and flex attention (#350) 
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-09-26 14:04:01 -07:00
h-guo18 4ff8fc9022 Example: add offline eagle training commands to README (#366) 
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-09-24 16:41:42 -07:00
h-guo18 26c203abde fix: update tests_eagle.py; disable eval for offline (#358) 
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-09-23 19:26:20 +00:00
Benjamin Chislettandh-guo18 add61dbbde Feature: Offline training for EAGLE3 (#300) 
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
Co-authored-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-09-22 23:54:09 +00:00
Keval Morabia c0590b0255 Deprecate ModelOpt custom docker and directly use TRT-LLM / PyTorch / TRT docker (#346) 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-09-23 01:43:25 +05:30
h-guo18 461980e6df update eagle example notebook (#314) 
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-09-17 14:17:50 -07:00
h-guo18 a6fa34cda4 Feat: update eagle3 example; add export (#293) 
Signed-off-by: h-guo18 <67671475+h-guo18@users.noreply.github.com>
 2025-09-08 18:02:41 -07:00
Keval Morabia cf6f1d4e23 Reduce eagle example test memory usage from 28 to 1 GB (#299) 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-09-08 21:35:15 +05:30
Keval Morabia 103b1bb137 Push latest changes 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-09-04 11:02:58 +05:30
Keval Morabia 1ef1d72a1b Code quality improvements - typos, formatting, etc. 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-09-02 19:58:33 +05:30
Keval Morabia 4d1eb0caf5 Major improvement of READMEs and documentation 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-08-30 10:54:28 +05:30
Keval Morabia d09c82779c Push latest changes and bug fixes (#274) 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-08-29 17:29:52 +05:30
Keval Morabia 37085354c9 Update files on Github (#258) 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-08-17 02:44:16 +05:30
Keval Morabia 4c611e47a6 Update files on GitHub 
Signed-off-by: Keval Morabia <28916987+kevalmorabia97@users.noreply.github.com>
 2025-07-31 22:48:09 +05:30
Keval Morabia 7af33d29ce Update for 0.31.0 release 2025-06-05 13:24:07 -07:00
Keval Morabia 7a047435ae Update for 0.29.0 release 2025-05-08 23:43:51 +05:30
Keval Morabia 9cb36cb43c Update files for 0.27.1 release 2025-04-15 23:36:35 +05:30
Keval Morabia 92f430f6ab Add files for 0.27.0 release 2025-04-03 10:31:41 +05:30
Keval Morabia 2017cd9063 Update for 0.25.0 release 2025-03-03 22:54:22 +05:30
Keval Morabia 5c9390c215 0.23.1 Release - fix for torch 2.6 2025-02-14 16:15:53 +05:30
Keval Morabia 73d6af785f Update 0.23.0 - OSS release 2025-01-29 01:45:47 +05:30