kanshan/TensorRT-LLMs
1
0
Fork 0
mirror of https://github.com/NVIDIA/TensorRT-LLM.git synced 2026-01-25 13:12:45 +08:00
Code Issues Actions 1 Packages Projects Releases Wiki Activity
1fca654bfd
TensorRT-LLMs/examples/scaffolding/contrib/mcp
History
Kunyao Wu 60a6c20174
Scaffoldingllm supports MCP (#4410) 
* support mcp

# Conflicts:
#	tensorrt_llm/scaffolding/worker.py

Signed-off-by: wu1du2 <wu1du2@gmail.com>

* move all into contrib/mcp

# Conflicts:
#	examples/scaffolding/contrib/mcp/mcptest.py
#	tensorrt_llm/scaffolding/__init__.py
#	tensorrt_llm/scaffolding/contrib/__init__.py
#	tensorrt_llm/scaffolding/contrib/mcp/__init__.py
#	tensorrt_llm/scaffolding/contrib/mcp/mcp_controller.py
#	tensorrt_llm/scaffolding/task.py
#	tensorrt_llm/scaffolding/worker.py

Signed-off-by: wu1du2 <wu1du2@gmail.com>

* support sandbox, websearch

# Conflicts:
#	examples/scaffolding/contrib/mcp/mcptest.py
#	examples/scaffolding/contrib/mcp/weather/weather.py
#	tensorrt_llm/scaffolding/contrib/mcp/mcp_controller.py
#	tensorrt_llm/scaffolding/contrib/mcp/mcp_utils.py
#	tensorrt_llm/scaffolding/contrib/mcp/mcp_worker.py
#	tensorrt_llm/scaffolding/worker.py

Signed-off-by: wu1du2 <wu1du2@gmail.com>

* remove pics

Signed-off-by: wu1du2 <wu1du2@gmail.com>

* pre-commit fix

# Conflicts:
#	tensorrt_llm/scaffolding/contrib/mcp/__init__.py
#	tensorrt_llm/scaffolding/contrib/mcp/mcp_utils.py
#	tensorrt_llm/scaffolding/contrib/mcp/mcp_worker.py

Signed-off-by: wu1du2 <wu1du2@gmail.com>

* fix spell

Signed-off-by: wu1du2 <wu1du2@gmail.com>

* rebase

Signed-off-by: wu1du2 <wu1du2@gmail.com>

---------

Signed-off-by: wu1du2 <wu1du2@gmail.com>
2025-05-23 01:54:49 +00:00
..
e2b Scaffoldingllm supports MCP (#4410) 2025-05-23 01:54:49 +00:00
weather Scaffoldingllm supports MCP (#4410) 2025-05-23 01:54:49 +00:00
websearch Scaffoldingllm supports MCP (#4410) 2025-05-23 01:54:49 +00:00
mcptest.py Scaffoldingllm supports MCP (#4410) 2025-05-23 01:54:49 +00:00
README.md Scaffoldingllm supports MCP (#4410) 2025-05-23 01:54:49 +00:00

README.md

MCP USAGE

Step1: Run Servers

Terminal1:

cd weather

pip install uv

uv add "mcp[cli]" httpx openai

uv pip install httpx mcp uv init --no-workspace uv run weather.py

Terminal2:

cd e2b

pip install uv

uv add "mcp[cli]" httpx openai

uv pip install e2b_code_interpreter mcp uv init --no-workspace uv run e2bserver.py

Terminal3:

cd websearch

pip install uv

uv add "mcp[cli]" httpx openai uv pip install brave-search mcp starlette uvicorn uv init --no-workspace uv run websearch.py

Step2: Run Test

python3 mcptest.py --API_KEY YOUR_API_KEY