kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
ccd73c71a5
TensorRT-LLMs/examples/scaffolding/contrib
History
narutolhy ccd73c71a5
feat: Add stream generation task scaffolding examples (#3527) 
* stream generation task/controller

Signed-off-by: narutolhy <582909902@qq.com>

* edit README

Signed-off-by: narutolhy <582909902@qq.com>

* rename README

Signed-off-by: narutolhy <582909902@qq.com>

---------

Signed-off-by: narutolhy <582909902@qq.com>
2025-04-16 11:33:55 +08:00
..
AsyncGeneration feat: Add stream generation task scaffolding examples (#3527) 2025-04-16 11:33:55 +08:00
__init__.py feat: Add stream generation task scaffolding examples (#3527) 2025-04-16 11:33:55 +08:00
README.md feat: Enhance the integrated robustness of scaffolding with __init__.py #3305 (#3312) 2025-04-09 21:13:47 +08:00

README.md

Contrib Examples

We create this directory to store the community contributed examples.

Contributors can add examples of customize inference time compute methods with customize Controller/Task/Worker.

We will continue to move some generic works on this directory back to the main code.

How to create a new project

Just create a new directory and add your code there.

How to make your code include Controller/Task/Worker can be reused by other projects

Just add your Controller/Task/Worker to the __init__.py file of contrib directory.