2390920b1d
* Add VisualQnA docker for both Gaudi and Xeon Signed-off-by: lvliang-intel <liang1.lv@intel.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * update token length Signed-off-by: lvliang-intel <liang1.lv@intel.com> --------- Signed-off-by: lvliang-intel <liang1.lv@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
12 lines
376 B
Bash
12 lines
376 B
Bash
#!/usr/bin/env bash
|
|
|
|
# Copyright (C) 2024 Intel Corporation
|
|
# SPDX-License-Identifier: Apache-2.0
|
|
|
|
export LVM_MODEL_ID="llava-hf/llava-v1.6-mistral-7b-hf"
|
|
export LVM_ENDPOINT="http://${host_ip}:8399"
|
|
export LVM_SERVICE_PORT=9399
|
|
export MEGA_SERVICE_HOST_IP=${host_ip}
|
|
export LVM_SERVICE_HOST_IP=${host_ip}
|
|
export BACKEND_SERVICE_ENDPOINT="http://${host_ip}:8888/v1/visualqna"
|