Part work of code refactor to combine different text generation backends, remove duplcated native langchain and llama_index folder, consice the optimum habana implementation as a native integration OPEATextGen_Native.
Add feature for issue https://github.com/opea-project/GenAIComps/issues/998
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
vllm-openvino is a dependency for text generation comps, move it to third-parties folder, add UT for both cpu and gpu.
Related to feature issue#998
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* Build guardrail "Hallucination Detection" microservice.
Signed-off-by: Qun Gao <qun.gao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Update comps/guardrails/hallucination_detection/README.md
Co-authored-by: Daniel De León <111013930+daniel-de-leon-user293@users.noreply.github.com>
* - register Dockerfile
- rename file for hpu
- update endpoints to be consistent
Signed-off-by: Qun Gao <qun.gao@intel.com>
* Update repo structure
Signed-off-by: Qun Gao <qun.gao@intel.com>
* refactor
Signed-off-by: Qun Gao <qun.gao@intel.com>
* Refactored Hallucination Guardrail to wrap code under new OpeaComponent Class and leaverage OpeaComponentLoader Class for serving inference.
Signed-off-by: Qun Gao <qun.gao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Updated Copyright year to reflect right date
Signed-off-by: Qun Gao <qun.gao@intel.com>
---------
Signed-off-by: Qun Gao <qun.gao@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Co-authored-by: Daniel De León <111013930+daniel-de-leon-user293@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Build Dockerfile.intel_gpu will fail because there are dependency conflict when vllm==v0.6.3.post1. Upgrading vllm to v0.6.6.post1 could solve the issue
Fixes#1141
Signed-off-by: Zhu, Yongbo <yongbo.zhu@intel.com>
* make naming style compatible to the defined style.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Automatically create issue in CIInfra to track the changes of docker compose
files for correspdonding helm charts.
Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
* docsum refine mode promt update
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* docsum vllm requirement update
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* docsum add auto mode
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* fix bug
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* fix bug
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* fix readme
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* refine
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* initial code for sql agent llama
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* add test for sql agent
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* update sql agent test
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* fix bugs and use vllm to test sql agent
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* add tag-bench test and google search tool
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* test sql agent with hints
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* fix bugs for sql agent with hints and update test
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add readme for sql agent and fix ci bugs
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add sql agent using openai models
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix bugs in sql agent openai
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* make wait time longer for sql agent microservice to be ready
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* update readme
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* fix test bug
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* skip planexec with vllm due to vllm-gaudi bug
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* debug ut issue
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* use vllm for all uts
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* debug ci issue
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* change vllm port
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* update ut
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* remove tgi server
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* align vllm port
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* remove unnecessary files and fix bugs
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* connect to db with full uri
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* update readme and use vllm mainstream
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* rm unnecessary log
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update readme
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* update test script
Signed-off-by: minmin-intel <minmin.hou@intel.com>
---------
Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* fix doc index retriever embed issue on gaudi
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* align test router with examples
* align readme
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
