jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 4 Packages Projects Releases Wiki Activity
1,123 Commits 43 Branches 9 Tags
update_vLLM
Commit Graph

66 Commits

Author SHA1 Message Date
CICD-at-OPEA
274af9eabc Update vLLM version to v0.9.0 
Signed-off-by: CICD-at-OPEA <CICD@opea.dev>
 2025-05-15 22:41:49 +00:00
CICD-at-OPEA
2160d43a32 Update vLLM version to v0.8.5 
Signed-off-by: CICD-at-OPEA <CICD@opea.dev>
 2025-05-08 08:37:52 +00:00
Sun, Xuehao
b467a13ec3 daily update vLLM&vLLM-fork version (#1914) 
Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
 2025-05-08 10:34:36 +08:00
ZePan110
00d7a65dd8 Enable model cache for Rocm docker compose test. (#1614) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-04-10 09:40:37 +08:00
Mustafa
892624f539 CodGen Examples using-RAG-and-Agents (#1757) 
Signed-off-by: Mustafa <mustafa.cetin@intel.com>
 2025-04-09 16:12:20 +08:00
ZePan110
5f4b3a6d12 Adaptation to vllm v0.8.3 build paths (#1761) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-04-09 13:20:02 +08:00
ZePan110
42735d0d7d Fix vllm and vllm-fork tags (#1766) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-04-07 22:58:50 +08:00
chyundunovDatamonsters
31b1d69e40 Adding files to deploy CodeGen application on ROCm vLLM (#1544) 
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
 2025-03-24 14:45:17 +08:00
xiguiw
effa2a28cf Enable CodeGen vLLM (#1636) 
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2025-03-13 10:38:47 +08:00
ZePan110
c1b5ba281f Enable CodeGen,CodeTrans and DocSum model cache for docker compose test. (#1599) 
1.Add cache path check
2.Enable CodeGen,CodeTrans and DocSum model cache for docker compose test.

Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-03-04 16:10:20 +08:00
dolpher
ee0e5cc8d9 Sync value files from GenAIInfra (#1428) 
All gaudi values updated with extra flags.
Added helm support for 2 new examples Text2Image and SearchQnA. Minor fix for llm-uservice.

Signed-off-by: Dolpher Du <dolpher.du@intel.com>
 2025-01-22 17:44:11 +08:00
chen, suyue
927698e23e Simplify git clone code in CI test (#1434) 
1. Simplify git clone code in CI test.
2. Replace git clone branch in Dockerfile.

Signed-off-by: chensuyue <suyue.chen@intel.com>
 2025-01-21 23:00:08 +08:00
dolpher
5638075d65 Add helm deployment instructions for codegen (#1351) 
Signed-off-by: Dolpher Du <dolpher.du@intel.com>
 2025-01-08 13:20:32 +08:00
ZePan110
aa5c91d7ee Check duplicated dockerfile (#1289) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-01-06 17:30:12 +08:00
chen, suyue
5c7a5bd850 Update Code and README for GenAIComps Refactor (#1285) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: WenjiaoYue <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>
 2025-01-02 20:03:26 +08:00
chen, suyue
6b6a08df78 Add minimal containers and ports clean up before test (#1291) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-12-26 10:59:26 +08:00
chen, suyue
cc108b5a18 Fix DBQnA image build (#1165) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-11-20 10:56:49 +08:00
chyundunovDatamonsters
83172e9a99 Adding files to deploy CodeGen application on AMD GPU (#1130) 
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-11-18 14:36:23 +08:00
Lianhao Lu
cbe952ec5e Fail CI manifest test if response content is not expected (#1145) 
Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
 2024-11-17 12:46:31 +08:00
lvliang-intel
1ff85f6a85 Upgrade TGI Gaudi version to v2.0.6 (#1088) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
 2024-11-12 14:38:22 +08:00
lvliang-intel
0306c620b5 Update TGI CPU image to latest official release 2.4.0 (#1035) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-11-04 11:28:43 +08:00
chen, suyue
eeced9b31c Enhance CI/CD image build (#961) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-10-17 14:33:58 +08:00
lvliang-intel
3fb60608b3 Use official tei gaudi image and update tgi gaudi version (#810) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-09-23 17:52:56 +08:00
XinyaoWa
2f03a3a894 Align parameters for "max_token, repetition_penalty,presence_penalty,frequency_penalty" (#726) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-09-19 14:15:25 +08:00
XinyaoWa
d73129cbf0 Refactor folder to support different vendors (#743) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-09-10 23:27:19 +08:00
Lianhao Lu
ba94e0130d Add ui/nginx support in K8S manifest for ChatQnA/CodeGen/CodeTrans/Docsum (#773) 
Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
 2024-09-10 16:30:14 +08:00
Ying Chun Guo
2a6af6491a update mount path in xeon k8s (#696) 
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
 2024-08-30 15:09:00 +08:00
Steve Zhang
f5f1e323bb Revert the LLM model for kubernetes GMS (#675) 
* revert the LLM model to meta-llama/CodeLlama-7b-hf
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
 2024-08-30 13:54:42 +08:00
chen, suyue
dfaf47978d optimize CI log format (#648) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-08-22 15:08:59 +08:00
Sihan Chen
6674832162 fix tgi xeon tag (#641) 2024-08-21 22:17:07 +08:00
lvliang-intel
b2771ad3f2 Using TGI official release docker image for intel cpu (#581) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
 2024-08-18 17:17:44 +08:00
Ying Chun Guo
71363a6b9d change microservice tags in CD workflow (#612) 
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
 2024-08-16 21:57:28 +08:00
chen, suyue
c26d0f62b8 Enhance CI/CD infrastructure (#593) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
 2024-08-15 22:39:21 +08:00
chen, suyue
965c13c556 rename docker compose.yaml (#446) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-07-26 20:03:36 +08:00
Jaswanth Karani
1b48e54a3d code-gen-react-ui (#417) 
* CodeGen: Manifest to deploy CodeGen with ReactUI into Kubernetes

Include manifest to deploy CodeGen pipeline with ReactUI into
Kubernetes. Include as well README file for the steps.

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

* code-gen-react-ui

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

* made changes as per PR suggestions

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* updated readme

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update base image

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

* updated codegn dockerfile react

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

* updated wait time

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

* updated as per PR comments

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

* aded react ui in gaudi test file

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

* fixed PR comments

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

* added docker pull for text-generation-model

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

* removed unused files

Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>

---------

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>
Co-authored-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
 2024-07-24 09:01:16 -07:00
Steve Zhang
290a74fae9 Update all examples yaml files of GMC in GenAIExample (#436) 
* Update all examples yaml files of GMC in GenAIExample.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
 2024-07-23 16:40:51 +08:00
Lianhao Lu
2f9397e012 Update Kubernetes manifest files for CodeGen (#441) 
Updated Kubernetes manifest files for CodeGen to reflect latest changes:
Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
 2024-07-23 14:07:42 +08:00
chen, suyue
bb42307af9 add docker compose yaml print for test (#433) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-07-22 15:36:03 +08:00
chen, suyue
3505bd25a4 update tgi-gaudi version (#389) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: Spycsh <sihan.chen@intel.com>
 2024-07-12 15:01:03 +08:00
Ying Chun Guo
15fc6f9711 Optimize gmc manifest e2e tests (#382) 
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
 2024-07-09 14:46:58 +08:00
Steve Zhang
2e62ecc18a add docsum example e2e test for GMC. (#347) 
* add docsum example e2e test for GMC.

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* fix curl error for docsum.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* change the manifest e2e yaml.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* change the image format.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* fixing image mapping error.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* change the gmc e2e test.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* accelarate the e2e test.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* change the gmc e2e configuration.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* retrigger.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Malini Bhandaru <malini.bhandaru@intel.com>
 2024-06-28 03:15:51 -07:00
chen, suyue
84a91bb990 solution for the conda-forge not available issue (#341) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-06-28 17:55:11 +08:00
Steve Zhang
960cf38d33 Add codegen e2e test of genaiexample (#337) 
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
 2024-06-28 10:42:00 +08:00
chen, suyue
e32a51451c Add build docker image option for test scripts (#312) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-06-24 23:33:46 +08:00
Ying Chun Guo
4fecd6a850 Add image build job in docker compose e2e gaudi test in CI (#305) 
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
 2024-06-21 14:22:34 +08:00
Ying Chun Guo
a0b94b5401 Add image build job in docker compose e2e xeon test in CI (#304) 
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
 2024-06-19 15:24:27 +08:00
Ying Chun Guo
c5f3095ea5 Add docker build job in manifest e2e workflow (#274) 
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
 2024-06-13 11:34:27 +08:00
Ying Chun Guo
26d6ea4724 Enable new CI runner and improve manifest e2e test scripts (#263) 
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
 2024-06-06 09:31:34 +08:00
Sun, Xuehao
dbee190e64 add UI test for codegen (#244) 
Signed-off-by: Yue, Wenjiao <wenjiao.yue@intel.com>
Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
 2024-05-31 21:22:59 +08:00
zehao-intel
b160010ad3 Modify UI Port for CodeGen to avoid unsafe_port issue (#249) 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
 2024-05-31 20:55:28 +08:00