jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

[Doc] Refine READMEs (#841)

Browse Source 
Signed-off-by: letonghan <letong.han@intel.com>
This commit is contained in:
Letong Han
2024-09-19 13:25:40 +08:00
committed by GitHub
parent 933c3d3445
commit 372d78c2ac
4 changed files with 25 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
DocSum/docker_compose/intel/hpu/gaudi/README.md
View File

@@ -96,7 +96,7 @@ docker compose up -d
1. TGI Service
```bash
curl http://${your_ip}:8008/generate \
curl http://${host_ip}:8008/generate \
-X POST \
-d '{"inputs":"What is Deep Learning?","parameters":{"max_new_tokens":64, "do_sample": true}}' \
-H 'Content-Type: application/json'
@@ -105,7 +105,7 @@ docker compose up -d
2. LLM Microservice
```bash
curl http://${your_ip}:9000/v1/chat/docsum \
curl http://${host_ip}:9000/v1/chat/docsum \
-X POST \
-d '{"query":"Text Embeddings Inference (TEI) is a toolkit for deploying and serving open source text embeddings and sequence classification models. TEI enables high-performance extraction for the most popular models, including FlagEmbedding, Ember, GTE and E5."}' \
-H 'Content-Type: application/json'