kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-14 06:27:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
e5400eeae0
TensorRT-LLMs/docs/source/blogs/media
History
Kaiyu Xie 5a5427f86e
blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 
Signed-off-by: juney-nvidia <143764042+juney-nvidia@users.noreply.github.com>
Co-authored-by: Xianjie <5410381+qiaoxj07@users.noreply.github.com>
Co-authored-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com>
Co-authored-by: Enwei Zhu <21126786+syuoni@users.noreply.github.com>
Co-authored-by: Jun Yang <143764042+juney-nvidia@users.noreply.github.com>
2025-06-05 22:24:04 +08:00
..
.gitkeep
Falcon180B-H200_acc.png
Falcon180B-H200_DecvOct.png
Falcon180B-H200_H200vA100.png
Falcon180B-H200_tps.png
H200launch_H200vsH100_tps.png
H200launch_tps.png
moe_structure.png
tech_blog1_fuse_a_gemm.png
tech_blog1_model_details.png
tech_blog1_model_overview.png
tech_blog1_router_gemm.png
tech_blog1_sparse_exp_as_a_gemm.png
tech_blog2_acc_relaxed_acceptance.png
tech_blog2_mtp_eagle.png
tech_blog2_mtp_modules.png
tech_blog2_mtp_vanilla.png
tech_blog2_overall_workflow.png
tech_blog2_perf_and_ar.png
tech_blog2_relaxed_acceptance.png
tech_blog2_tree_spec_decoding.png
tech_blog2_verify_and_accept.png
tech_blog3_mla_absorb.png DeepSeek R1 throughut optimization tech blog for Blackwell GPUs (#4791) 2025-05-30 18:54:19 +08:00
tech_blog4_Picture1.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture2.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture3.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture4.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture5.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture6.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture7.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture8.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture9.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture10.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture11.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture12.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture13.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture14.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture15.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture16.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture17.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture18.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture19.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture20.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture21.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture22.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture23.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture24.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tech_blog4_Picture25.png blog: Scaling Expert Parallelism in TensorRT-LLM (Part 1: Design and Implementation of Large-scale EP) (#4958) 2025-06-05 22:24:04 +08:00
tp_ep.png
TRT_LLM_v0-5-0_H100vA100_1st.png
TRT_LLM_v0-5-0_H100vA100_tps.png
XQA_ThroughputvsLatency.png