update codetrans default model (#1015)
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
This commit is contained in:
@@ -57,9 +57,9 @@ Then run the command `docker images`, you will have the following Docker Images:
|
||||
|
||||
By default, the LLM model is set to a default value as listed below:
|
||||
|
||||
| Service | Model |
|
||||
| ------- | ----------------------------- |
|
||||
| LLM | HuggingFaceH4/mistral-7b-grok |
|
||||
| Service | Model |
|
||||
| ------- | ---------------------------------- |
|
||||
| LLM | mistralai/Mistral-7B-Instruct-v0.3 |
|
||||
|
||||
Change the `LLM_MODEL_ID` below for your needs.
|
||||
|
||||
|
||||
@@ -49,9 +49,9 @@ Then run the command `docker images`, you will have the following Docker Images:
|
||||
|
||||
By default, the LLM model is set to a default value as listed below:
|
||||
|
||||
| Service | Model |
|
||||
| ------- | ----------------------------- |
|
||||
| LLM | HuggingFaceH4/mistral-7b-grok |
|
||||
| Service | Model |
|
||||
| ------- | ---------------------------------- |
|
||||
| LLM | mistralai/Mistral-7B-Instruct-v0.3 |
|
||||
|
||||
Change the `LLM_MODEL_ID` below for your needs.
|
||||
|
||||
|
||||
@@ -4,7 +4,7 @@
|
||||
# SPDX-License-Identifier: Apache-2.0
|
||||
|
||||
|
||||
export LLM_MODEL_ID="HuggingFaceH4/mistral-7b-grok"
|
||||
export LLM_MODEL_ID="mistralai/Mistral-7B-Instruct-v0.3"
|
||||
export TGI_LLM_ENDPOINT="http://${host_ip}:8008"
|
||||
export MEGA_SERVICE_HOST_IP=${host_ip}
|
||||
export LLM_SERVICE_HOST_IP=${host_ip}
|
||||
|
||||
Reference in New Issue
Block a user