jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 4 Packages Projects Releases Wiki Activity

[Doc]Add a micro/mega service WorkFlow for DocSum (#537)

Browse Source 
* Update README.md

added a micro/megaservice workflow for Doc Sum

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>

* Update README.md

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>

* fix format issue

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>

---------

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
This commit is contained in:
Louie Tsai
2024-08-20 18:49:28 -07:00
committed by GitHub
parent 87617e761c
commit 343d614591
1 changed files with 23 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

23
DocSum/README.md
View File

@@ -90,6 +90,29 @@ Install Helm (version >= 3.15) first. Refer to the [Helm Installation Guide](htt
Refer to the [DocSum helm chart](https://github.com/opea-project/GenAIInfra/tree/main/helm-charts/docsum) for instructions on deploying DocSum into Kubernetes on Xeon & Gaudi.
### Workflow of the deployed Document Summarization Service
The workflow of the Document Summarization Service, from user's input query to the application's output response, is as follows:
```mermaid
flowchart LR
subgraph DocSum
direction LR
A[User] <--> |Input query| B[DocSum Gateway]
B <--> |Post| Megaservice
subgraph Megaservice["Megaservice"]
direction TB
C([ Microservice : llm-docsum-tgi <br>9000]) -. Post .-> D{{TGI Service<br>8008}}
end
Megaservice --> |Output| E[Response]
end
subgraph Legend
X([Micsrservice])
Y{{Service from industry peers}}
Z[Gateway]
end
```
## Consume Document Summarization Service
Two ways of consuming Document Summarization Service: