[CodeGen] Add correct ip to no_proxy list; add no_proxy env for all services; add ui response in readme (#279)
* add no_proxy for all microservices Signed-off-by: Chun Tao <chun.tao@intel.com> * Update readme Signed-off-by: Chun Tao <chun.tao@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci --------- Signed-off-by: Chun Tao <chun.tao@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
This commit is contained in:
BIN
CodeGen/assets/img/codeGen_ui_response.png
Normal file
BIN
CodeGen/assets/img/codeGen_ui_response.png
Normal file
Binary file not shown.
|
After Width: | Height: | Size: 391 KiB |
@@ -58,7 +58,14 @@ Then run the command `docker images`, you will have the following 3 Docker Image
|
||||
|
||||
Since the `docker_compose.yaml` will consume some environment variables, you need to setup them in advance as below.
|
||||
|
||||
**Append the value of the public IP address to the no_proxy list**
|
||||
|
||||
```
|
||||
export your_no_proxy=${your_no_proxy},"External_Public_IP"
|
||||
```
|
||||
|
||||
```bash
|
||||
export no_proxy=${your_no_proxy}
|
||||
export http_proxy=${your_http_proxy}
|
||||
export https_proxy=${your_http_proxy}
|
||||
export LLM_MODEL_ID="meta-llama/CodeLlama-7b-hf"
|
||||
@@ -139,6 +146,10 @@ To access the frontend, open the following URL in your browser: `http://{host_ip
|
||||
|
||||

|
||||
|
||||
Here is an example of running CodeGen in the UI:
|
||||
|
||||

|
||||
|
||||
## Install Copilot VSCode extension from Plugin Marketplace as the frontend
|
||||
|
||||
In addition to the Svelte UI, users can also install the Copilot VSCode extension from the Plugin Marketplace as the frontend.
|
||||
|
||||
@@ -14,6 +14,7 @@ services:
|
||||
- "./data:/data"
|
||||
shm_size: 1g
|
||||
environment:
|
||||
no_proxy: ${no_proxy}
|
||||
http_proxy: ${http_proxy}
|
||||
https_proxy: ${https_proxy}
|
||||
HF_TOKEN: ${HUGGINGFACEHUB_API_TOKEN}
|
||||
@@ -27,6 +28,7 @@ services:
|
||||
- "9000:9000"
|
||||
ipc: host
|
||||
environment:
|
||||
no_proxy: ${no_proxy}
|
||||
http_proxy: ${http_proxy}
|
||||
https_proxy: ${https_proxy}
|
||||
TGI_LLM_ENDPOINT: ${TGI_LLM_ENDPOINT}
|
||||
@@ -43,6 +45,7 @@ services:
|
||||
ports:
|
||||
- "7778:7778"
|
||||
environment:
|
||||
- no_proxy=${no_proxy}
|
||||
- https_proxy=${https_proxy}
|
||||
- http_proxy=${http_proxy}
|
||||
- MEGA_SERVICE_HOST_IP=${MEGA_SERVICE_HOST_IP}
|
||||
@@ -57,6 +60,7 @@ services:
|
||||
ports:
|
||||
- "5173:5173"
|
||||
environment:
|
||||
- no_proxy=${no_proxy}
|
||||
- https_proxy=${https_proxy}
|
||||
- http_proxy=${http_proxy}
|
||||
- BASIC_URL=${BACKEND_SERVICE_ENDPOINT}
|
||||
|
||||
Reference in New Issue
Block a user