mirror of
https://github.com/NVIDIA/TensorRT-LLM.git
synced 2026-01-14 06:27:45 +08:00
42 lines
2.0 KiB
YAML
42 lines
2.0 KiB
YAML
# Adapted from https://github.com/vllm-project/vllm/tree/main/.github/ISSUE_TEMPLATE/600-new-model.yml
|
|
name: 🤗 Support request for a new model from huggingface
|
|
description: Submit a proposal/request for a new model from huggingface
|
|
title: "[New Model]: "
|
|
labels: ["new model"]
|
|
|
|
body:
|
|
- type: markdown
|
|
attributes:
|
|
value: >
|
|
#### Before submitting an issue, please make sure the issue hasn't been already addressed by searching through [the existing and past issues](https://github.com/NVIDIA/TensorRT-LLM/issues?q=is%3Aissue+sort%3Acreated-desc+).
|
|
|
|
#### We also highly recommend you read https://nvidia.github.io/TensorRT-LLM/architecture/add-model.html first to understand how to add a new model.
|
|
- type: textarea
|
|
attributes:
|
|
label: The model to consider.
|
|
description: >
|
|
A huggingface identifier, pointing to the model, e.g. `meta-llama/Llama-3.1-8B-Instruct` .
|
|
validations:
|
|
required: true
|
|
- type: textarea
|
|
attributes:
|
|
label: The closest model TensorRT-LLM already supports.
|
|
description: >
|
|
Here is the list of models already supported by TensorRT-LLM: https://github.com/NVIDIA/TensorRT-LLM/tree/main/tensorrt_llm/models (TRT backend) and https://github.com/NVIDIA/TensorRT-LLM/tree/main/tensorrt_llm/_torch/models (Pytorch backend) . Which model is the most similar to the model you want to add support for?
|
|
- type: textarea
|
|
attributes:
|
|
label: What's your difficulty of supporting the model you want?
|
|
description: >
|
|
For example, any new operators or new architecture?
|
|
- type: markdown
|
|
attributes:
|
|
value: >
|
|
Thanks for contributing 🎉!
|
|
- type: checkboxes
|
|
id: askllm
|
|
attributes:
|
|
label: Before submitting a new issue...
|
|
options:
|
|
- label: Make sure you already searched for relevant issues, and checked the [documentation](https://nvidia.github.io/TensorRT-LLM/) and [examples](https://github.com/NVIDIA/TensorRT-LLM/tree/main/examples) for answers to frequently asked questions.
|
|
required: true
|