jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

update codetrans default model (#1015)

Browse Source 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
This commit is contained in:
XinyaoWa
2024-10-28 09:11:54 +08:00
committed by GitHub
parent 89f4c5fb41
commit a2afce1675
13 changed files with 21 additions and 21 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
CodeTrans/kubernetes/intel/README.md
View File

@@ -14,7 +14,7 @@ By default, the LLM model is set to a default value as listed below:
|Service |Model |
|---------|-------------------------|
|LLM |HuggingFaceH4/mistral-7b-grok|
|LLM |mistralai/Mistral-7B-Instruct-v0.3|
Change the `MODEL_ID` in `codetrans.yaml` for your needs.

2
CodeTrans/kubernetes/intel/README_gmc.md
View File

@@ -13,7 +13,7 @@ By default, the LLM model is set to a default value as listed below:
|Service |Model |
|---------|-------------------------|
|LLM |HuggingFaceH4/mistral-7b-grok|
|LLM |mistralai/Mistral-7B-Instruct-v0.3|
Change the `MODEL_ID` in `codetrans_xeon.yaml` for your needs.

2
CodeTrans/kubernetes/intel/cpu/xeon/gmc/codetrans_xeon.yaml
View File

@@ -29,6 +29,6 @@ spec:
internalService:
serviceName: tgi-service
config:
MODEL_ID: HuggingFaceH4/mistral-7b-grok
MODEL_ID: mistralai/Mistral-7B-Instruct-v0.3
endpoint: /generate
isDownstreamService: true

2
CodeTrans/kubernetes/intel/cpu/xeon/manifest/codetrans.yaml
View File

@@ -64,7 +64,7 @@ metadata:
app.kubernetes.io/version: "2.1.0"
app.kubernetes.io/managed-by: Helm
data:
MODEL_ID: "HuggingFaceH4/mistral-7b-grok"
MODEL_ID: "mistralai/Mistral-7B-Instruct-v0.3"
PORT: "2080"
HF_TOKEN: "insert-your-huggingface-token-here"
http_proxy: ""

2
CodeTrans/kubernetes/intel/hpu/gaudi/gmc/codetrans_gaudi.yaml
View File

@@ -29,6 +29,6 @@ spec:
internalService:
serviceName: tgi-gaudi-svc
config:
MODEL_ID: HuggingFaceH4/mistral-7b-grok
MODEL_ID: mistralai/Mistral-7B-Instruct-v0.3
endpoint: /generate
isDownstreamService: true

2
CodeTrans/kubernetes/intel/hpu/gaudi/manifest/codetrans.yaml
View File

@@ -64,7 +64,7 @@ metadata:
app.kubernetes.io/version: "2.1.0"
app.kubernetes.io/managed-by: Helm
data:
MODEL_ID: "HuggingFaceH4/mistral-7b-grok"
MODEL_ID: "mistralai/Mistral-7B-Instruct-v0.3"
PORT: "2080"
HF_TOKEN: "insert-your-huggingface-token-here"
http_proxy: ""