jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 5 Packages Projects Releases Wiki Activity
1,123 Commits 43 Branches 9 Tags
update_vLLM
Commit Graph

20 Commits

Author SHA1 Message Date
Wang, Kai Lawrence
3d3ac59bfb [ChatQnA] Update the default LLM to llama3-8B on cpu/gpu/hpu (#1430) 
Update the default LLM to llama3-8B on cpu/nvgpu/amdgpu/gaudi for docker-compose deployment to avoid the potential model serving issue or the missing chat-template issue using neural-chat-7b.

Slow serving issue of neural-chat-7b on ICX: #1420
Signed-off-by: Wang, Kai Lawrence <kai.lawrence.wang@intel.com>
 2025-01-20 22:47:56 +08:00
Liang Lv
0f7e5a37ac Adapt code for dataprep microservice refactor (#1408) 
https://github.com/opea-project/GenAIComps/pull/1153

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
 2025-01-20 20:37:03 +08:00
Letong Han
4cabd55778 Refactor Retrievers related Examples (#1387) 
Delete redundant retrievers docker image in docker_images_list.md.
Refactor Retrievers related Examples READMEs.
Change all of the comps/retrievers/xxx/xxx/Dockerfile path into comps/retrievers/src/Dockerfile.

Fix the Examples CI issues of PR opea-project/GenAIComps#1138.
Signed-off-by: letonghan <letong.han@intel.com>
 2025-01-16 14:21:48 +08:00
Liang Lv
3ca78867eb Update example code for embedding dependency moving to 3rd_party (#1368) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
 2025-01-10 15:36:58 +08:00
chen, suyue
5c7a5bd850 Update Code and README for GenAIComps Refactor (#1285) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: WenjiaoYue <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>
 2025-01-02 20:03:26 +08:00
Wang, Kai Lawrence
ac470421d0 Update the llm backend ports (#1172) 
Signed-off-by: Wang, Kai Lawrence <kai.lawrence.wang@intel.com>
 2024-11-22 09:20:09 +08:00
Wang, Kai Lawrence
2587179224 Add instructions of modifying reranking docker image for NVGPU (#1133) 
Signed-off-by: Wang, Kai Lawrence <kai.lawrence.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-11-18 15:37:32 +08:00
Letong Han
aa314f6757 [Readme] Update ChatQnA Readme for LLM Endpoint (#1086) 
Signed-off-by: letonghan <letong.han@intel.com>
 2024-11-11 13:53:06 +08:00
Wang, Kai Lawrence
f7026773b8 [ChatQnA] Fix the no_proxy setting for gpu example (#1078) 
Signed-off-by: Wang, Kai Lawrence <kai.lawrence.wang@intel.com>
 2024-11-08 22:27:51 +08:00
Wang, Kai Lawrence
944ae47948 [ChatQnA] Fix the service connection issue on GPU and modify the emb backend (#1059) 
Signed-off-by: Wang, Kai Lawrence <kai.lawrence.wang@intel.com>
 2024-11-06 10:22:21 +08:00
xiguiw
a0921f127f [Doc] Fix broken build instruction (#1063) 
Signed-off-by: Wang, Xigui <xigui.wang@intel.com>
 2024-11-05 13:35:12 +08:00
lvliang-intel
619d941047 Set no wrapper ChatQnA as default (#891) 
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-10-11 13:30:45 +08:00
Letong Han
c35fe0b429 [Doc] Update ChatQnA README for Nginx Docker Image (#862) 
Signed-off-by: letonghan <letong.han@intel.com>
 2024-09-23 12:25:30 +09:00
Letong Han
7eaab93d0b [Doc] Refine ChatQnA README (#855) 
Signed-off-by: letonghan <letong.han@intel.com>
 2024-09-20 11:20:20 +08:00
Neo Zhang Jianyu
bc817700b9 refactor the network port setting for AWS (#849) 
Co-authored-by: ZhangJianyu <zhang.jianyu@outlook.com>
 2024-09-19 21:58:56 +08:00
Letong Han
6c364487d3 [ChatQnA] Add Nginx in Docker Compose and README (#850) 
Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-09-19 20:39:58 +08:00
XinyaoWa
2f03a3a894 Align parameters for "max_token, repetition_penalty,presence_penalty,frequency_penalty" (#726) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-09-19 14:15:25 +08:00
kevinintel
3b70fb0d42 Refine the quick start of ChatQnA (#828) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-09-18 22:23:22 +08:00
XinyaoWa
d2bab99835 refine readme for reorg (#782) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-09-11 14:57:29 +08:00
XinyaoWa
d73129cbf0 Refactor folder to support different vendors (#743) 
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
 2024-09-10 23:27:19 +08:00