Add README.md for CodeGen UT scripts. Optimization test check. Signed-off-by: ZePan110 <ze.pan@intel.com>
34 lines
428 B
Markdown
34 lines
428 B
Markdown
# CodeGen E2E test scripts
|
|
|
|
## Set the required environment variable
|
|
|
|
```bash
|
|
export HUGGINGFACEHUB_API_TOKEN="Your_Huggingface_API_Token"
|
|
```
|
|
|
|
## Run test
|
|
|
|
On Intel Xeon with TGI:
|
|
|
|
```bash
|
|
bash test_compose_on_xeon.sh
|
|
```
|
|
|
|
On Intel Gaudi with TGI:
|
|
|
|
```bash
|
|
bash test_compose_on_gaudi.sh
|
|
```
|
|
|
|
On AMD ROCm with TGI:
|
|
|
|
```bash
|
|
bash test_compose_on_rocm.sh
|
|
```
|
|
|
|
On AMD ROCm with vLLM:
|
|
|
|
```bash
|
|
bash test_compose_vllm_on_rocm.sh
|
|
```
|