graphrag/graphrag/config/models
Derek Worthen 2b70e4a4f3
Tokenizer (#2051)
* Add LiteLLM chat and embedding model providers.

* Fix code review findings.

* Add litellm.

* Fix formatting.

* Update dictionary.

* Update litellm.

* Fix embedding.

* Remove manual use of tiktoken and replace with
Tokenizer interface. Adds support for encoding
and decoding the models supported by litellm.

* Update litellm.

* Configure litellm to drop unsupported params.

* Cleanup semversioner release notes.

* Add num_tokens util to Tokenizer interface.

* Update litellm service factories.

* Cleanup litellm chat/embedding model argument assignment.

* Update chat and embedding type field for litellm use and future migration away from fnllm.

* Flatten litellm service organization.

* Update litellm.

* Update litellm factory validation.

* Flatten litellm rate limit service organization.

* Update rate limiter - disable with None/null instead of 0.

* Fix usage of get_tokenizer.

* Update litellm service registrations.

* Add jitter to exponential retry.

* Update validation.

* Update validation.

* Add litellm request logging layer.

* Update cache key.

* Update defaults.

---------

Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2025-09-22 13:55:14 -06:00
..
__init__.py Improve CLI speed with lazy imports (#1319) 2024-11-15 19:41:10 -05:00
basic_search_config.py Fix/minor query fixes (#1893) 2025-04-25 14:12:18 -07:00
cache_config.py Refactor CacheFactory, StorageFactory, and VectorStoreFactory to use consistent registration patterns and add custom vector store documentation (#2006) 2025-08-28 13:53:07 -07:00
chunking_config.py Refactor config defaults (#1723) 2025-02-20 13:01:29 -06:00
cluster_graph_config.py Refactor config defaults (#1723) 2025-02-20 13:01:29 -06:00
community_reports_config.py Support OpenAI reasoning models (#1841) 2025-04-22 14:15:26 -07:00
drift_search_config.py Support OpenAI reasoning models (#1841) 2025-04-22 14:15:26 -07:00
embed_graph_config.py Refactor config defaults (#1723) 2025-02-20 13:01:29 -06:00
extract_claims_config.py Support OpenAI reasoning models (#1841) 2025-04-22 14:15:26 -07:00
extract_graph_config.py Support OpenAI reasoning models (#1841) 2025-04-22 14:15:26 -07:00
extract_graph_nlp_config.py Configure async for NLP extraction (#2059) 2025-09-16 11:52:18 -07:00
global_search_config.py Support OpenAI reasoning models (#1841) 2025-04-22 14:15:26 -07:00
graph_rag_config.py Tokenizer (#2051) 2025-09-22 13:55:14 -06:00
input_config.py Pipeline registration (#1940) 2025-06-12 16:14:39 -07:00
language_model_config.py Tokenizer (#2051) 2025-09-22 13:55:14 -06:00
local_search_config.py Support OpenAI reasoning models (#1841) 2025-04-22 14:15:26 -07:00
prune_graph_config.py Refactor config defaults (#1723) 2025-02-20 13:01:29 -06:00
reporting_config.py Refactor CacheFactory, StorageFactory, and VectorStoreFactory to use consistent registration patterns and add custom vector store documentation (#2006) 2025-08-28 13:53:07 -07:00
snapshots_config.py Snapshot full graph (#1889) 2025-04-25 14:14:48 -07:00
storage_config.py Refactor CacheFactory, StorageFactory, and VectorStoreFactory to use consistent registration patterns and add custom vector store documentation (#2006) 2025-08-28 13:53:07 -07:00
summarize_descriptions_config.py Refactor CacheFactory, StorageFactory, and VectorStoreFactory to use consistent registration patterns and add custom vector store documentation (#2006) 2025-08-28 13:53:07 -07:00
text_embedding_config.py Refactor CacheFactory, StorageFactory, and VectorStoreFactory to use consistent registration patterns and add custom vector store documentation (#2006) 2025-08-28 13:53:07 -07:00
umap_config.py Refactor config defaults (#1723) 2025-02-20 13:01:29 -06:00
vector_store_config.py Custom vector store schema implementation (#2062) 2025-09-19 10:11:34 -07:00
vector_store_schema_config.py Custom vector store schema implementation (#2062) 2025-09-19 10:11:34 -07:00