17 Commits

Author	SHA1	Message	Date
dongxuy04	21aff2e313	feat: large-scale EP(part 2: MoE Load Balancer - core utilities) (#4384) ... * first commit of cpp moe loadbalance code Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add python bindings for moe load balance Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add python wrapper, ut and bug fixes Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add binding for layerId and update binding test Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> * add host tensor sharing and ut Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com> --------- Signed-off-by: Dongxu Yang <78518666+dongxuy04@users.noreply.github.com>	2025-05-20 17:53:48 +08:00
Robin Kobus	403370af62	refactor: Move ModelSpec to core library (#3980) ... * refactor: Move ModelSpec from tests to core library Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * refactor: Move ModelSpec from runtime to separatedir Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * refactor: Use new bindings path and clean up Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Updated licenses Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> * chore: Remove script_dir from path Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com> --------- Signed-off-by: Robin Kobus <19427718+Funatiq@users.noreply.github.com>	2025-05-04 01:39:09 +08:00
Kaiyu Xie	77d7fe1eb2	Update TensorRT-LLM (#2849) ... * Update TensorRT-LLM --------- Co-authored-by: aotman <chenhangatm@gmail.com>	2025-03-04 18:44:00 +08:00
Kaiyu Xie	ab5b19e027	Update TensorRT-LLM (#2820)	2025-02-25 21:21:49 +08:00
Dan Blanaru	16d2467ea8	Update TensorRT-LLM (#2755) ... * Update TensorRT-LLM --------- Co-authored-by: Denis Kayshev <topenkoff@gmail.com> Co-authored-by: akhoroshev <arthoroshev@gmail.com> Co-authored-by: Patrick Reiter Horn <patrick.horn@gmail.com> Update	2025-02-11 03:01:00 +00:00
Kaiyu Xie	be17881062	Update TensorRT-LLM (#2582)	2024-12-16 21:50:47 -08:00
Kaiyu Xie	535c9cc673	Update TensorRT-LLM (#2460)	2024-11-19 18:30:34 +08:00
Kaiyu Xie	b7868dd1bd	Update TensorRT-LLM (#2413)	2024-11-05 16:27:06 +08:00
Kaiyu Xie	8681b3a4c0	open source 4dbf696ae9b74a26829d120b67ab8443d70c8e58 (#2297) ... * Update TensorRT-LLM --------- Co-authored-by: Bhuvanesh Sridharan <bhuvanesh.sridharan@sprinklr.com> Co-authored-by: Qingquan Song <ustcsqq@gmail.com>	2024-10-08 12:19:19 +02:00
Dan Blanaru	48686bca3a	open source 7f370deb0090d885d7518c2b146399ba3933c004 (#2273) ... * Update TensorRT-LLM --------- Co-authored-by: Qingquan Song <ustcsqq@gmail.com>	2024-09-30 13:51:19 +02:00
石晓伟	2a115dae84	Update TensorRT-LLM (#1793) ... Co-authored-by: DreamGenX <x@dreamgen.com> Co-authored-by: Ace-RR <78812427+Ace-RR@users.noreply.github.com> Co-authored-by: bprus <39293131+bprus@users.noreply.github.com> Co-authored-by: janpetrov <janpetrov@icloud.com>	2024-06-18 18:18:23 +08:00
石晓伟	850b6fa1e7	Update TensorRT-LLM (#1358) ... Co-authored-by: Kaiyu <26294424+kaiyux@users.noreply.github.com>	2024-03-26 20:47:14 +08:00
Kaiyu Xie	66ca3378c6	Update TensorRT-LLM (#1315)	2024-03-19 17:36:42 +08:00
Kaiyu Xie	0ab9d17a59	Update TensorRT-LLM (#1055) ... * Update TensorRT-LLM --------- Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>	2024-02-06 18:38:07 +08:00
Kaiyu Xie	e06f537e08	Update TensorRT-LLM (#1019) ... * Update TensorRT-LLM --------- Co-authored-by: erenup <ping.nie@pku.edu.cn> Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>	2024-01-31 21:55:32 +08:00
Kaiyu Xie	711a28d9bf	Update TensorRT-LLM (#465) ... * Update TensorRT-LLM --------- Co-authored-by: Shixiaowei02 <39303645+Shixiaowei02@users.noreply.github.com>	2023-11-24 22:12:26 +08:00
Kaiyu Xie	f044eb8d94	Update TensorRT-LLM (#302) ... * Update TensorRT-LLM --------- Co-authored-by: wangruohui <12756472+wangruohui@users.noreply.github.com>	2023-11-07 19:51:58 +08:00