Yao Qing 2159f9ad00 Fix vllm microservice performance issue. (#731) ...

* Fix vllm microservice performance issue.

Signed-off-by: Yao, Qing <qing.yao@intel.com>

* Refine llm generate parameters

Signed-off-by: Yao, Qing <qing.yao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Yao, Qing <qing.yao@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

2024-09-25 21:37:38 +08:00

..

langchain

Fix vllm microservice performance issue. (#731)

2024-09-25 21:37:38 +08:00

llama_index

Align parameters for "max_token, repetition_penalty,presence_penalty,frequency_penalty" (#608)

2024-09-18 20:39:23 +08:00

ray

Update README.md for Multiplatforms (#707)

2024-09-18 17:43:55 -07:00