jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
1,130 Commits 43 Branches 9 Tags
update_vLLM-fork
Commit Graph

36 Commits

Author SHA1 Message Date
ZePan110
8a9f3f4351 Organize set_env.sh paths and update README.md (#1920) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Ying Hu <ying.hu@intel.com>
 2025-05-20 10:05:00 +08:00
ZePan110
8d421b7912 [Translation] Integrate set_env.sh into test scripts. (#1785) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
 2025-04-11 09:31:40 +08:00
ZePan110
00d7a65dd8 Enable model cache for Rocm docker compose test. (#1614) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-04-10 09:40:37 +08:00
Xiaotian Chen
1bd56af994 Update TGI image versions (#1625) 
Signed-off-by: xiaotia3 <xiaotian.chen@intel.com>
 2025-04-01 11:27:51 +08:00
chyundunovDatamonsters
340fa075bd Adding files to deploy Translation application on ROCm vLLM (#1648) 
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
Signed-off-by: Artem Astafev <a.astafev@datamonsters.com>
 2025-03-31 13:49:33 +08:00
ZePan110
e4de76da78 Use model cache for docker compose test (#1582) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-03-04 09:48:27 +08:00
dolpher
ee0e5cc8d9 Sync value files from GenAIInfra (#1428) 
All gaudi values updated with extra flags.
Added helm support for 2 new examples Text2Image and SearchQnA. Minor fix for llm-uservice.

Signed-off-by: Dolpher Du <dolpher.du@intel.com>
 2025-01-22 17:44:11 +08:00
chen, suyue
0ba3decb6b Simplify git clone code in CI test (#1422) 
1. Simplify git clone code in CI test. 
2. Replace git clone branch in Dockerfile.

Signed-off-by: chensuyue <suyue.chen@intel.com>
 2025-01-20 23:55:20 +08:00
xiguiw
2d5898244c Enchance health check in GenAIExample docker-compose (#1410) 
Fix service launch issue

1. Update Gaudi TGI image from 2.0.6 to 2.3.1
2. Change the hpu-gaudi TGI health check condition.

Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
 2025-01-20 20:13:13 +08:00
dolpher
c795ef2203 Add helm deployment instructions for GenAIExamples (#1373) 
Add helm deployment instructions for ChatQnA, AgentQnA, AudioQnA, CodeTrans, DocSum, FaqGen and VisualQnA

Signed-off-by: Dolpher Du <dolpher.du@intel.com>
 2025-01-10 09:55:31 +08:00
ZePan110
aa5c91d7ee Check duplicated dockerfile (#1289) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-01-06 17:30:12 +08:00
chen, suyue
5c7a5bd850 Update Code and README for GenAIComps Refactor (#1285) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: WenjiaoYue <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>
 2025-01-02 20:03:26 +08:00
chyundunovDatamonsters
75b0961a48 Translation App - Adding files to deploy Translation application on AMD GPU (#1191) 
Signed-off-by: artem-astafev <a.astafev@datamonsters.com>
 2025-01-02 09:19:44 +08:00
chen, suyue
cc108b5a18 Fix DBQnA image build (#1165) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-11-20 10:56:49 +08:00
chen, suyue
9ba034b22d fix the docker image name for release image build (#1152) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-11-18 23:48:01 +08:00
lvliang-intel
1ff85f6a85 Upgrade TGI Gaudi version to v2.0.6 (#1088) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
 2024-11-12 14:38:22 +08:00
lvliang-intel
0306c620b5 Update TGI CPU image to latest official release 2.4.0 (#1035) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-11-04 11:28:43 +08:00
chen, suyue
eeced9b31c Enhance CI/CD image build (#961) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-10-17 14:33:58 +08:00
lvliang-intel
3fb60608b3 Use official tei gaudi image and update tgi gaudi version (#810) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-09-23 17:52:56 +08:00
Letong Han
1e130314d9 [Translation] Support manifests and nginx (#812) 
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: root <root@a4bf019305c5.jf.intel.com>
Co-authored-by: root <root@a4bf019305c5.jf.intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-09-19 07:08:13 +08:00
XinyaoWa
d73129cbf0 Refactor folder to support different vendors (#743) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-09-10 23:27:19 +08:00
chen, suyue
4f3be23efa fix translation gaudi env (#653) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-08-22 20:00:05 +08:00
chen, suyue
dfaf47978d optimize CI log format (#648) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-08-22 15:08:59 +08:00
chen, suyue
a6385bc6fd Fix left issues in CI/CD structure refactor (#599) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-08-16 00:22:24 +08:00
chen, suyue
c26d0f62b8 Enhance CI/CD infrastructure (#593) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
 2024-08-15 22:39:21 +08:00
chen, suyue
965c13c556 rename docker compose.yaml (#446) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-07-26 20:03:36 +08:00
Steve Zhang
d0b028d199 Add new example of Translation for GenAIExample (#455) 
* Add Translation GMC pipeline
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
 2024-07-25 09:26:41 +08:00
WenjiaoYue
284d855bf4 Translate UT for UI (#423) 
Signed-off-by: Yue, Wenjiao <wenjiao.yue@intel.com>
 2024-07-23 17:14:33 +08:00
chen, suyue
b7975e79d8 refactor translation ci test (#438) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-07-23 10:17:24 +08:00
chen, suyue
3505bd25a4 update tgi-gaudi version (#389) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: Spycsh <sihan.chen@intel.com>
 2024-07-12 15:01:03 +08:00
chen, suyue
84a91bb990 solution for the conda-forge not available issue (#341) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-06-28 17:55:11 +08:00
zehao-intel
409c72350e Refactor Translation Example (#287) 
* Refactor Translation Example

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* support e2s test

Signed-off-by: zehao-intel <zehao.huang@intel.com>

Signed-off-by: zehao-intel <zehao.huang@intel.com>

Signed-off-by: zehao-intel <zehao.huang@intel.com>

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* fix test ip_address

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* update test scripts

Signed-off-by: chensuyue <suyue.chen@intel.com>

* update test scripts

Signed-off-by: chensuyue <suyue.chen@intel.com>

* for test

Signed-off-by: chensuyue <suyue.chen@intel.com>

* fix readme and dockerfile

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* revert test code

Signed-off-by: chensuyue <suyue.chen@intel.com>

* remove gaudi test update

Signed-off-by: chensuyue <suyue.chen@intel.com>

* bug fix

Signed-off-by: chensuyue <suyue.chen@intel.com>

* fix test xeon

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* modify mega check

Signed-off-by: zehao-intel <zehao.huang@intel.com>

Signed-off-by: zehao-intel <zehao.huang@intel.com>

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* fix ui

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* fix ut network

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* fix network

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* Modify the corresponding format according to the backend new structure. (#317)

* Add image build job in docker compose e2e gaudi test in CI (#305)

Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>

* Add gpu support for ChatQnA (#308)

* add gpu support for chatqna

Signed-off-by: Ding, Ke <ke.ding@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Ding, Ke <ke.ding@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Update ChatQnA for Xeon docker_compose.yaml to fix downloads failing (#310)

* Update docker_compose

* Updated docker_compose

* Updated docker_compose

* Add build docker image option for test scripts (#312)

Signed-off-by: chensuyue <suyue.chen@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
Signed-off-by: Ding, Ke <ke.ding@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: WenjiaoYue <wenjiao.yue@intel.com>
Co-authored-by: Ying Chun Guo <yingchun.guo@intel.com>
Co-authored-by: Ke Ding <ke.ding@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Steve Fowler <william.fowler@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>

---------

Signed-off-by: zehao-intel <zehao.huang@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
Signed-off-by: Ding, Ke <ke.ding@intel.com>
Signed-off-by: WenjiaoYue <wenjiao.yue@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: WenjiaoYue <wenjiao.yue@intel.com>
Co-authored-by: Ying Chun Guo <yingchun.guo@intel.com>
Co-authored-by: Ke Ding <ke.ding@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Steve Fowler <william.fowler@intel.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
 2024-06-25 13:22:27 +08:00
chen, suyue
509d5c66ca unify license copyright (#234) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-05-31 17:19:30 +08:00
chen, suyue
7eb402e95b Revert hf_token setting (#226) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-05-30 23:12:03 +08:00
lvliang-intel
9d3bc0e00c Fix huggingface hub token environment variable (#214) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
 2024-05-30 16:04:59 +08:00
zehao-intel
5c71489921 Add the Language Translation Example (#94) 
Signed-off-by: zehao-intel <zehao.huang@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-04-30 17:54:29 +08:00