Enable CodeGen,CodeTrans and DocSum model cache for docker compose test. (#1599)

1.Add cache path check
2.Enable CodeGen,CodeTrans and DocSum model cache for docker compose test.

Signed-off-by: ZePan110 <ze.pan@intel.com>
This commit is contained in:
ZePan110
2025-03-04 16:10:20 +08:00
committed by GitHub
parent 8f8d3af7c3
commit c1b5ba281f
12 changed files with 19 additions and 7 deletions

View File

@@ -21,7 +21,7 @@ services:
timeout: 10s
retries: 100
volumes:
- "./data:/data"
- "${MODEL_CACHE}:/data"
shm_size: 1g
command: --model-id ${LLM_MODEL_ID} --cuda-graphs 0 --max-input-length ${MAX_INPUT_TOKENS} --max-total-tokens ${MAX_TOTAL_TOKENS}