kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-29 07:02:56 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
5e2cf02f46
TensorRT-LLMs/_images/Tensor_Parallelism_Vis.svg
Kaiyu Xie bb9465295f Fix main page 
Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com>
2025-04-26 05:56:13 +00:00

2 lines
12 KiB
XML
Raw Blame History

<svg width="12444" height="4836" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" xml:space="preserve" overflow="hidden"><g transform="translate(-100 -1342)"><g><rect x="10730" y="2303" width="946" height="3872" fill="#76B900" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 10901.9 4296)">Layer 6</text><rect x="1188" y="2303" width="946" height="3872" fill="#76B900" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 1360.27 4296)">Layer 1</text><rect x="3097" y="2303" width="946" height="3872" fill="#76B900" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 3268.6 4296)">Layer 2</text><rect x="5005" y="2303" width="946" height="3872" fill="#76B900" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 5176.93 4296)">Layer 3</text><rect x="6913" y="2303" width="946" height="3872" fill="#76B900" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 7085.26 4296)">Layer 4</text><rect x="8822" y="2303" width="946" height="3872" fill="#76B900" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 8993.6 4296)">Layer 5</text><path d="M473 4239 12518 4239" stroke="#8C8C8C" stroke-width="45.8333" stroke-linecap="butt" stroke-linejoin="round" stroke-miterlimit="10" stroke-opacity="1" fill="none" fill-rule="evenodd"/><path d="M105 2460.67C105 2373.59 175.591 2303 262.669 2303L893.331 2303C980.409 2303 1051 2373.59 1051 2460.67L1051 4000.33C1051 4087.41 980.409 4158 893.331 4158L262.669 4158C175.591 4158 105 4087.41 105 4000.33Z" fill="#008564" fill-rule="evenodd" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 329.761 3288)">GPU 0</text><text fill="#000000" fill-opacity="1" font-family="NVIDIA Sans,NVIDIA Sans_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 5305.85 1569)">Tenso</text><text fill="#000000" fill-opacity="1" font-family="NVIDIA Sans,NVIDIA Sans_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 5809.05 1569)">r</text><text fill="#000000" fill-opacity="1" font-family="NVIDIA Sans,NVIDIA Sans_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 5929.37 1569)">Parallelism 2 </text><text fill="#000000" fill-opacity="1" font-family="NVIDIA Sans,NVIDIA Sans_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 7048.3 1569)">(TP </text><text fill="#000000" fill-opacity="1" font-family="NVIDIA Sans,NVIDIA Sans_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 7376.58 1569)">2)</text><path d="M105 4443.67C105 4356.59 175.591 4286 262.669 4286L893.33 4286C980.409 4286 1051 4356.59 1051 4443.67L1051 5982.33C1051 6069.41 980.409 6140 893.33 6140L262.669 6140C175.591 6140 105 6069.41 105 5982.33Z" fill="#008564" fill-rule="evenodd" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 329.761 5270)">GPU 1</text><path d="M2206 3861.5C2206 3786.11 2267.11 3725 2342.5 3725L2888.5 3725C2963.89 3725 3025 3786.11 3025 3861.5L3025 4617.5C3025 4692.89 2963.89 4754 2888.5 4754L2342.5 4754C2267.11 4754 2206 4692.89 2206 4617.5Z" fill="#5D1682" fill-rule="evenodd" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 2496.14 4197)">All</text><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 2712.13 4197)">-</text><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 2319.29 4395)">Reduce</text><path d="M4114 3861.67C4114 3786.19 4175.19 3725 4250.67 3725L4797.33 3725C4872.81 3725 4934 3786.19 4934 3861.67L4934 4617.33C4934 4692.81 4872.81 4754 4797.33 4754L4250.67 4754C4175.19 4754 4114 4692.81 4114 4617.33Z" fill="#5D1682" fill-rule="evenodd" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 4404.47 4197)">All</text><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 4620.46 4197)">-</text><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 4227.62 4395)">Reduce</text><path d="M6014 3861.67C6014 3786.19 6075.19 3725 6150.67 3725L6697.33 3725C6772.81 3725 6834 3786.19 6834 3861.67L6834 4617.33C6834 4692.81 6772.81 4754 6697.33 4754L6150.67 4754C6075.19 4754 6014 4692.81 6014 4617.33Z" fill="#5D1682" fill-rule="evenodd" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 6304.64 4197)">All</text><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 6520.63 4197)">-</text><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 6127.79 4395)">Reduce</text><path d="M7939 3861.5C7939 3786.11 8000.11 3725 8075.5 3725L8621.5 3725C8696.89 3725 8758 3786.11 8758 3861.5L8758 4617.5C8758 4692.89 8696.89 4754 8621.5 4754L8075.5 4754C8000.11 4754 7939 4692.89 7939 4617.5Z" fill="#5D1682" fill-rule="evenodd" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 8229.3 4197)">All</text><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 8445.29 4197)">-</text><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 8052.46 4395)">Reduce</text><path d="M9831 3861.5C9831 3786.11 9892.11 3725 9967.5 3725L10513.5 3725C10588.9 3725 10650 3786.11 10650 3861.5L10650 4617.5C10650 4692.89 10588.9 4754 10513.5 4754L9967.5 4754C9892.11 4754 9831 4692.89 9831 4617.5Z" fill="#5D1682" fill-rule="evenodd" fill-opacity="1"/><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 10098.9 4197)">All</text><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 10314.9 4197)">-</text><text fill="#FFFFFF" fill-opacity="1" font-family="Trebuchet MS,Trebuchet MS_MSFontService,sans-serif" font-style="normal" font-variant="normal" font-weight="400" font-stretch="normal" font-size="183" text-anchor="start" direction="ltr" writing-mode="lr-tb" unicode-bidi="normal" text-decoration="none" transform="matrix(1 0 0 1 9944.46 4395)">Reduce</text></g></g></svg>
Reference in New Issue View Git Blame Copy Permalink