jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 5 Packages Projects Releases Wiki Activity

change codegen tgi model (#646)

Browse Source 
* change codegen tgi model

Signed-off-by: KfreeZ <kefei.zhang@intel.com>
This commit is contained in:
Kefei Zhang
2024-08-22 11:42:57 +08:00
committed by GitHub
parent e6b4fff05c
commit 06cb308611
2 changed files with 2 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
CodeGen/kubernetes/codegen_gaudi.yaml
View File

@@ -29,6 +29,6 @@ spec:
internalService:
serviceName: tgi-gaudi-svc
config:
MODEL_ID: ise-uiuc/Magicoder-S-DS-6.7B
MODEL_ID: meta-llama/CodeLlama-7b-hf
endpoint: /generate
isDownstreamService: true

2
CodeGen/kubernetes/codegen_xeon.yaml
View File

@@ -29,6 +29,6 @@ spec:
internalService:
serviceName: tgi-service
config:
MODEL_ID: ise-uiuc/Magicoder-S-DS-6.7B
MODEL_ID: HuggingFaceH4/mistral-7b-grok
endpoint: /generate
isDownstreamService: true