graphrag/graphrag/index
Derek Worthen 2b70e4a4f3
Tokenizer (#2051)
* Add LiteLLM chat and embedding model providers.

* Fix code review findings.

* Add litellm.

* Fix formatting.

* Update dictionary.

* Update litellm.

* Fix embedding.

* Remove manual use of tiktoken and replace with
Tokenizer interface. Adds support for encoding
and decoding the models supported by litellm.

* Update litellm.

* Configure litellm to drop unsupported params.

* Cleanup semversioner release notes.

* Add num_tokens util to Tokenizer interface.

* Update litellm service factories.

* Cleanup litellm chat/embedding model argument assignment.

* Update chat and embedding type field for litellm use and future migration away from fnllm.

* Flatten litellm service organization.

* Update litellm.

* Update litellm factory validation.

* Flatten litellm rate limit service organization.

* Update rate limiter - disable with None/null instead of 0.

* Fix usage of get_tokenizer.

* Update litellm service registrations.

* Add jitter to exponential retry.

* Update validation.

* Update validation.

* Add litellm request logging layer.

* Update cache key.

* Update defaults.

---------

Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
2025-09-22 13:55:14 -06:00
..
input Improve internal logging functionality by using Python's standard logging module (#1956) 2025-07-09 18:29:03 -06:00
operations Tokenizer (#2051) 2025-09-22 13:55:14 -06:00
run Input docs API parameter (#2034) 2025-09-02 16:15:50 -07:00
text_splitting Tokenizer (#2051) 2025-09-22 13:55:14 -06:00
typing Input docs API parameter (#2034) 2025-09-02 16:15:50 -07:00
update Update Index as workflows (#1908) 2025-04-30 16:25:36 -06:00
utils Remove community reports rate limiter (#2056) 2025-09-18 13:40:24 -07:00
workflows Configure async for NLP extraction (#2059) 2025-09-16 11:52:18 -07:00
__init__.py Improve CLI speed with lazy imports (#1319) 2024-11-15 19:41:10 -05:00
validate_config.py Improve internal logging functionality by using Python's standard logging module (#1956) 2025-07-09 18:29:03 -06:00