jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Refine ChatQnA README for TGI (#715)

Browse Source 
* update chatqna readme for tgi

Signed-off-by: letonghan <letong.han@intel.com>

* update log block

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
This commit is contained in:
Letong Han
2024-09-03 15:06:50 +08:00
committed by GitHub
parent e5ec38c796
commit afc3341156
5 changed files with 75 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

13
ChatQnA/README.md
View File

@@ -224,6 +224,19 @@ Refer to the [Intel Technology enabling for Openshift readme](https://github.com
## Consume ChatQnA Service
Before consuming ChatQnA Service, make sure the TGI/vLLM service is ready (which takes up to 2 minutes to start).
```bash
# TGI example
docker logs tgi-service | grep Connected
```
Consume ChatQnA service until you get the TGI response like below.
```log
2024-09-03T02:47:53.402023Z INFO text_generation_router::server: router/src/server.rs:2311: Connected
```
Two ways of consuming ChatQnA Service:
1. Use cURL command on terminal