Venky 62fea1e885 test(perf): Add Llama-3.1-Nemotron-8B-v1 to perf tests (#3822) ... * **Model:** Llama-3.1-Nemotron-Nano-8B-v1 * **Precision:** float16 * **Environment:** * GPUs: 1 H100 PCIe * Driver: 570.86.15 * **Test String:** `llama_v3.1_nemotron_nano_8b-bench-pytorch-float16-input_output_len:128,128` * **Request Throughput:** 81.86 req/sec * **Total Token Throughput:** 20956.44 tokens/sec * **Average Request Latency:** 5895.24 ms * **Test String:** `llama_v3.1_nemotron_nano_8b-bench-pytorch-float16-input_output_len:2000,2000` * **Request Throughput:** 1.45 req/sec * **Total Token Throughput:** 5783.92 tokens/sec * **Average Request Latency:** 211541.08 ms * **Test String:** `llama_v3.1_nemotron_nano_8b-bench-float16-maxbs:128-input_output_len:128,128` * **Request Throughput:** 52.75 req/sec * **Total Token Throughput:** 13505.00 tokens/sec * **Average Request Latency:** 5705.50 ms * **Test String:** `llama_v3.1_nemotron_nano_8b-bench-float16-maxbs:128-input_output_len:2000,2000` * **Request Throughput:** 1.41 req/sec * **Total Token Throughput:** 5630.76 tokens/sec * **Average Request Latency:** 217139.59 ms Signed-off-by: Venky Ganesh <gvenkatarama@nvidia.com>		2025-05-06 17:17:55 -07:00
..
dev	Update (#2978)	2025-03-23 16:39:35 +08:00
qa	test(perf): Add Llama-3.1-Nemotron-8B-v1 to perf tests (#3822)	2025-05-06 17:17:55 -07:00
test-db	fix: trtllm-serve hang in stress test and ds v3 stress parameter update (#3836)	2025-05-06 16:52:30 +08:00
waives.txt	[Test]: Clean up stale waives (#4062)	2025-05-05 22:13:12 +08:00