kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
ed887940d4
TensorRT-LLMs/cpp/kernels/xqa/nvrtc
History
Ming Wei ed887940d4
infra: open source XQA kernels (#3762) 
Replace libtensorrt_llm_nvrtc_wrapper.so with its source code, which
consists of two parts:

1. NVRTC glue code
2. XQA kernel code

During TensorRT-LLM build, XQA kernel code is embedded as C++ arries via
gen_cpp_header.py and passed to NVRTC for JIT compilation.

Signed-off-by: Ming Wei <2345434+ming-wei@users.noreply.github.com>
2025-04-30 18:05:15 +08:00
..
Makefile infra: open source XQA kernels (#3762) 2025-04-30 18:05:15 +08:00
test_nvrtc.cpp infra: open source XQA kernels (#3762) 2025-04-30 18:05:15 +08:00