jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Update ChatQnA helm chart README. (#1459)

Browse Source 
Signed-off-by: Dolpher Du <dolpher.du@intel.com>
This commit is contained in:
dolpher
2025-01-23 10:54:39 +08:00
committed by GitHub
parent f0fea7b706
commit 9b0f98be8b
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
ChatQnA/kubernetes/helm/README.md
View File

@@ -14,17 +14,17 @@ helm install chatqna oci://ghcr.io/opea-project/charts/chatqna --set global.HUG
```
export HFTOKEN="insert-your-huggingface-token-here"
helm install chatqna oci://ghcr.io/opea-project/charts/chatqna --set global.HUGGINGFACEHUB_API_TOKEN=${HFTOKEN} -f gaudi-values.yaml
helm install chatqna oci://ghcr.io/opea-project/charts/chatqna --set global.HUGGINGFACEHUB_API_TOKEN=${HFTOKEN} -f gaudi-vllm-values.yaml
```
## Deploy variants of ChatQnA
ChatQnA is configurable and you can enable/disable features by providing values.yaml file.
For example, to run with vllm instead of tgi on Gaudi hardware, use gaudi-vllm-values.yaml file:
For example, to run with tgi instead of vllm inference engine on Gaudi hardware, use gaudi-tgi-values.yaml file:
```
export HFTOKEN="insert-your-huggingface-token-here"
helm install chatqna oci://ghcr.io/opea-project/charts/chatqna --set global.HUGGINGFACEHUB_API_TOKEN=${HFTOKEN} -f gaudi-vllm-values.yaml
helm install chatqna oci://ghcr.io/opea-project/charts/chatqna --set global.HUGGINGFACEHUB_API_TOKEN=${HFTOKEN} -f gaudi-tgi-values.yaml
```
See other *-values.yaml files in this directory for more reference.