jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 5 Packages Projects Releases Wiki Activity
1,138 Commits 43 Branches 9 Tags
opt-multimodelqna
Commit Graph

66 Commits

Author SHA1 Message Date
ZePan110
8a9f3f4351 Organize set_env.sh paths and update README.md (#1920) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Ying Hu <ying.hu@intel.com>
 2025-05-20 10:05:00 +08:00
Sun, Xuehao
b467a13ec3 daily update vLLM&vLLM-fork version (#1914) 
Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
 2025-05-08 10:34:36 +08:00
Melanie Hart Buehler
7bb05585b6 Move file processing from UI to DocSum backend service (#1899) 
Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>
 2025-05-08 09:05:30 +08:00
ZePan110
99b62ae49e Integrate DocSum set_env to ut scripts. (#1860) 
Integrate DocSum set_env to ut scripts.
Add README.md for DocSum and InstructionTuning UT scripts.

Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-04-28 13:35:05 +08:00
ZePan110
00d7a65dd8 Enable model cache for Rocm docker compose test. (#1614) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-04-10 09:40:37 +08:00
ZePan110
5f4b3a6d12 Adaptation to vllm v0.8.3 build paths (#1761) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-04-09 13:20:02 +08:00
ZePan110
42735d0d7d Fix vllm and vllm-fork tags (#1766) 
Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-04-07 22:58:50 +08:00
chyundunovDatamonsters
319dbdaa6b Adding files to deploy DocSum application on ROCm vLLM (#1572) 
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
 2025-04-03 14:20:23 +08:00
Xiaotian Chen
1bd56af994 Update TGI image versions (#1625) 
Signed-off-by: xiaotia3 <xiaotian.chen@intel.com>
 2025-04-01 11:27:51 +08:00
Letong Han
d4dcbd18ef Enable vllm for DocSum (#1716) 
Set vllm as default llm serving, and add related docker compose files, readmes, and test scripts.

Fix issue #1436

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2025-03-28 17:15:01 +08:00
chen, suyue
2204fe8e36 Enable base image build in CI/CD (#1669) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2025-03-19 09:21:51 +08:00
ZePan110
c1b5ba281f Enable CodeGen,CodeTrans and DocSum model cache for docker compose test. (#1599) 
1.Add cache path check
2.Enable CodeGen,CodeTrans and DocSum model cache for docker compose test.

Signed-off-by: ZePan110 <ze.pan@intel.com>
 2025-03-04 16:10:20 +08:00
chen, suyue
81b02bb947 Revert "HUGGINGFACEHUB_API_TOKEN environment is change to HF_TOKEN (#… (#1521) 
Revert this PR since the test is not triggered properly due to the false merge of a WIP CI PR, 44a689b0bf, which block the CI test.

This change will be submitted in another PR.
 2025-02-11 18:36:12 +08:00
xiguiw
45d5da2ddd HUGGINGFACEHUB_API_TOKEN environment is change to HF_TOKEN (#1503) 
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
 2025-02-09 20:33:06 +08:00
dolpher
ee0e5cc8d9 Sync value files from GenAIInfra (#1428) 
All gaudi values updated with extra flags.
Added helm support for 2 new examples Text2Image and SearchQnA. Minor fix for llm-uservice.

Signed-off-by: Dolpher Du <dolpher.du@intel.com>
 2025-01-22 17:44:11 +08:00
chen, suyue
927698e23e Simplify git clone code in CI test (#1434) 
1. Simplify git clone code in CI test.
2. Replace git clone branch in Dockerfile.

Signed-off-by: chensuyue <suyue.chen@intel.com>
 2025-01-21 23:00:08 +08:00
chen, suyue
6bfd156573 Clean up test scripts and enhance git clone (#1417) 
1. Clean up test code in scripts.
2. Simplify git clone code.
3. Replace git clone branch in Dockerfile.

Signed-off-by: chensuyue <suyue.chen@intel.com>
 2025-01-20 16:34:28 +08:00
XinyaoWa
39409d7f61 Align OpenAI API for FaqGen, DocSum (#1401) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
 2025-01-17 11:19:35 +08:00
XinyaoWa
71e3c57366 Standardize name for LLM comps (#1402) 
Update all the names for classes and files in llm comps to follow the standard format, related GenAIComps PR opea-project/GenAIComps#1162

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
 2025-01-16 23:10:27 +08:00
XinyaoWa
ff1310b11a Refactor docsum (#1336) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
 2025-01-13 15:49:48 +08:00
dolpher
c795ef2203 Add helm deployment instructions for GenAIExamples (#1373) 
Add helm deployment instructions for ChatQnA, AgentQnA, AudioQnA, CodeTrans, DocSum, FaqGen and VisualQnA

Signed-off-by: Dolpher Du <dolpher.du@intel.com>
 2025-01-10 09:55:31 +08:00
Sihan Chen
a01729a5c2 Refactor DocSum example (#1286) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-12-26 14:45:17 +08:00
XinyaoWa
50dd959d60 Support Long context for DocSum (#1255) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lkk <33276950+lkk12014402@users.noreply.github.com>
 2024-12-20 19:17:10 +08:00
chyundunovDatamonsters
67634dfd22 DocSum - Solving the problem of running DocSum on ROCm (#1268) 
Signed-off-by: Chingis Yundunov <YundunovCN@sibedge.com>
 2024-12-18 17:38:38 +08:00
Omar Khleif
00b526c8e5 Changed Default UI to Gradio (#1246) 
Signed-off-by: okhleif-IL <omar.khleif@intel.com>
 2024-12-11 11:04:10 -08:00
Mustafa
07e47a1f38 Update tests for issue 1229 (#1231) 
Signed-off-by: Mustafa <mustafa.cetin@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-12-07 09:07:52 +08:00
chen, suyue
cc108b5a18 Fix DBQnA image build (#1165) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-11-20 10:56:49 +08:00
XinyaoWa
0cdeb946e4 DocSum Manifest support multimedia (#1158) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-11-18 18:46:01 +08:00
Mustafa
eb91d1f054 Docsum (#1095) 
Signed-off-by: Mustafa <mustafa.cetin@intel.com>
Signed-off-by: Harsha Ramayanam <harsha.ramayanam@intel.com>
Co-authored-by: Harsha Ramayanam <harsha.ramayanam@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: XinyaoWa <xinyao.wang@intel.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
 2024-11-18 17:15:42 +08:00
Artem Astafev
b1bb6db52d Add compose example for DocSum amd rocm deployment (#1125) 
Signed-off-by: Artem Astafev <a.astafev@datamonsters.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-11-18 09:09:12 +08:00
Lianhao Lu
cbe952ec5e Fail CI manifest test if response content is not expected (#1145) 
Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
 2024-11-17 12:46:31 +08:00
lvliang-intel
1ff85f6a85 Upgrade TGI Gaudi version to v2.0.6 (#1088) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
 2024-11-12 14:38:22 +08:00
WenjiaoYue
3744bb8c1b Fix docSum ui error in accessing parsed files (#1079) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Neo Zhang Jianyu <jianyu.zhang@intel.com>
Co-authored-by: ZhangJianyu <zhang.jianyu@outlook.com>
Co-authored-by: XinyaoWa <xinyao.wang@intel.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
 2024-11-11 09:10:12 +08:00
lvliang-intel
98f66405ac Update docsum test command line format (#1027) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
 2024-10-25 15:39:05 +08:00
chen, suyue
eeced9b31c Enhance CI/CD image build (#961) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-10-17 14:33:58 +08:00
lvliang-intel
3fb60608b3 Use official tei gaudi image and update tgi gaudi version (#810) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-09-23 17:52:56 +08:00
XinyaoWa
d73129cbf0 Refactor folder to support different vendors (#743) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-09-10 23:27:19 +08:00
Lianhao Lu
ba94e0130d Add ui/nginx support in K8S manifest for ChatQnA/CodeGen/CodeTrans/Docsum (#773) 
Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
 2024-09-10 16:30:14 +08:00
Ying Chun Guo
2a6af6491a update mount path in xeon k8s (#696) 
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
 2024-08-30 15:09:00 +08:00
chen, suyue
dfaf47978d optimize CI log format (#648) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-08-22 15:08:59 +08:00
Ying Chun Guo
71363a6b9d change microservice tags in CD workflow (#612) 
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
 2024-08-16 21:57:28 +08:00
chen, suyue
a6385bc6fd Fix left issues in CI/CD structure refactor (#599) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-08-16 00:22:24 +08:00
chen, suyue
c26d0f62b8 Enhance CI/CD infrastructure (#593) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
 2024-08-15 22:39:21 +08:00
chen, suyue
965c13c556 rename docker compose.yaml (#446) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-07-26 20:03:36 +08:00
Jaswanth Karani
edf0d14c95 added doc sum react-ui (#418) 
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: jaswanth8888 <karani.jaswanth@gmail.com>
 2024-07-25 12:12:36 +08:00
Lianhao Lu
83146320aa Add Kubernetes manifest files for deploying DocSum (#434) 
* Add Kubernetes manifest files for deploying DocSum

Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
 2024-07-23 13:29:32 +08:00
chen, suyue
bb42307af9 add docker compose yaml print for test (#433) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-07-22 15:36:03 +08:00
chen, suyue
3505bd25a4 update tgi-gaudi version (#389) 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: Spycsh <sihan.chen@intel.com>
 2024-07-12 15:01:03 +08:00
Ying Chun Guo
15fc6f9711 Optimize gmc manifest e2e tests (#382) 
Signed-off-by: Yingchun Guo <yingchun.guo@intel.com>
 2024-07-09 14:46:58 +08:00
Steve Zhang
2e62ecc18a add docsum example e2e test for GMC. (#347) 
* add docsum example e2e test for GMC.

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* fix curl error for docsum.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* change the manifest e2e yaml.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* change the image format.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* fixing image mapping error.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* change the gmc e2e test.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* accelarate the e2e test.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* change the gmc e2e configuration.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* retrigger.
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: Yingchun Guo <yingchun.guo@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Malini Bhandaru <malini.bhandaru@intel.com>
 2024-06-28 03:15:51 -07:00