Signed-off-by: supriya-krishnamurthi <supriya.krishnamurthi@intel.com> Signed-off-by: Yogesh <yogeshpandey@intel.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: lvliang-intel <liang1.lv@intel.com> Co-authored-by: Yogesh <yogeshpandey@intel.com> Co-authored-by: Hoong Tee, Yeoh <hoong.tee.yeoh@intel.com> Co-authored-by: Yogesh Pandey <yogesh.pandey@intel.com>
9 lines
233 B
Bash
Executable File
9 lines
233 B
Bash
Executable File
#!/usr/bin/env bash
|
|
|
|
# Copyright (C) 2024 Intel Corporation
|
|
# SPDX-License-Identifier: Apache-2.0
|
|
|
|
export TGI_PORT=8008
|
|
export TGI_LLM_ENDPOINT="http://${your_ip}:${TGI_PORT}"
|
|
export LLM_MODEL_ID="mistralai/Mistral-7B-Instruct-v0.3"
|