jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

CodeGen README updates (#534)

Browse Source 
Signed-off-by: dmsuehir <dina.s.jones@intel.com>
This commit is contained in:
Dina Suehiro Jones
2024-08-06 22:30:39 -07:00
committed by GitHub
parent 7dd9952f5e
commit 17b9676a3d
1 changed files with 6 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
CodeGen/README.md
View File

@@ -30,7 +30,7 @@ Currently we support two ways of deploying ChatQnA services with docker compose:
docker pull opea/codegen:latest docker pull opea/codegen:latest
``` ```
2. Start services using the docker images `built from source`: [Guide](./docker) 2. Start services using the docker images built from source. See the [Gaudi Guide](./docker/gaudi/README.md) or [Xeon Guide](./docker/xeon/README.md) for more information.
### Setup Environment Variable ### Setup Environment Variable
@@ -55,6 +55,10 @@ To set up environment variables for deploying ChatQnA services, follow these ste
3. Set up other environment variables: 3. Set up other environment variables:
> Note: By default, the [`docker/set_env.sh`](docker/set_env.sh) file will configure your environment
> variables to use [meta-llama/CodeLlama-7b-hf](https://huggingface.co/meta-llama/CodeLlama-7b-hf). This
> is a gated model that requires submitting an access request through Hugging Face.
```bash ```bash
source ./docker/set_env.sh source ./docker/set_env.sh
``` ```
@@ -70,7 +74,7 @@ cd GenAIExamples/CodeGen/docker/gaudi
docker compose up -d docker compose up -d
``` ```
> Notice: Currently only the **Habana Driver 1.16.xi** is supported for Gaudi. > Notice: Currently only the **Habana Driver 1.16.x** is supported for Gaudi.
Refer to the [Gaudi Guide](./docker/gaudi/README.md) to build docker images from source. Refer to the [Gaudi Guide](./docker/gaudi/README.md) to build docker images from source.