jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

[Doc] Update CodeGen and Translation READMEs (#847)

Browse Source 
Signed-off-by: letonghan <letong.han@intel.com>
This commit is contained in:
Letong Han
2024-09-19 16:01:35 +08:00
committed by GitHub
parent f04f061f8c
commit a09395e4a4
6 changed files with 66 additions and 13 deletions
Download Patch File Download Diff File Expand all files Collapse all files

32
Translation/docker_compose/intel/cpu/xeon/README.md
View File

@@ -10,9 +10,24 @@ For detailed information about these instance types, you can refer to this [link
After launching your instance, you can connect to it using SSH (for Linux instances) or Remote Desktop Protocol (RDP) (for Windows instances). From there, you'll have full access to your Xeon server, allowing you to install, configure, and manage your applications as needed.
## 🚀 Build Docker Images
## 🚀 Prepare Docker Images
First of all, you need to build Docker Images locally and install the python package of it.
For Docker Images, you have two options to prepare them.
1. Pull the docker images from docker hub.
- More stable to use.
- Will be automatically downloaded when using docker compose command.
2. Build the docker images from source.
- Contain the latest new features.
- Need to be manually build.
If you choose to pull docker images form docker hub, skip this section and go to [Start Microservices](#start-microservices) part directly.
Follow the instructions below to build the docker images from source.
### 1. Build LLM Image
@@ -45,7 +60,7 @@ docker build -t opea/translation-ui:latest --build-arg https_proxy=$https_proxy
```bash
cd GenAIComps
docker build -t opea/translation-nginx:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/nginx/Dockerfile .
docker build -t opea/nginx:latest --build-arg https_proxy=$https_proxy --build-arg http_proxy=$http_proxy -f comps/nginx/Dockerfile .
```
Then run the command `docker images`, you will have the following Docker Images:
@@ -53,7 +68,7 @@ Then run the command `docker images`, you will have the following Docker Images:
1. `opea/llm-tgi:latest`
2. `opea/translation:latest`
3. `opea/translation-ui:latest`
4. `opea/translation-nginx:latest`
4. `opea/nginx:latest`
## 🚀 Start Microservices
@@ -101,6 +116,15 @@ Change the `LLM_MODEL_ID` below for your needs.
docker compose up -d
```
> Note: The docker images will be automatically downloaded from `docker hub`:
```bash
docker pull opea/llm-tgi:latest
docker pull opea/translation:latest
docker pull opea/translation-ui:latest
docker pull opea/nginx:latest
```
### Validate Microservices
1. TGI Service