Commit Graph

3 Commits

Author SHA1 Message Date
XinyaoWa
fab1fbdfe9 Add logging for unified debug (#521)
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
2024-08-20 22:09:04 +08:00
lvliang-intel
cc8cd702ae Remove unnecessary langsmith dependency (#369)
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
2024-08-18 17:11:13 +08:00
XinyaoWa
4c0afd05a7 Add knowledge graph components (#171)
* enable ragas (#129)

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Fix RAG performance issues (#132)

* Fix RAG performance issues

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* add microservice level perf statistics (#135)

* add statistics

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Add More Contents to the Table of MicroService (#141)

* Add More Contents to the Table MicroService

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* reorder

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* Update README.md

* refine structure

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix model

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* refine table

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* put llm to the ground

Signed-off-by: zehao-intel <zehao.huang@intel.com>

---------

Signed-off-by: zehao-intel <zehao.huang@intel.com>
Co-authored-by: Sihan Chen <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Use common security content for OPEA projects (#151)

* add python coverage

Signed-off-by: chensuyue <suyue.chen@intel.com>

* docs update

Signed-off-by: chensuyue <suyue.chen@intel.com>

* Revert "add python coverage"

This reverts commit 69615b16c8e7483f9fea742d1d3fa0707075a394.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Enable vLLM Gaudi support for LLM service based on officially habana vllm release (#137)

Signed-off-by: tianyil1 <tianyi.liu@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* add knowledge graph

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* knowledge graph microservice update

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Support Dataprep Microservice with Llama Index (#154)

* move file to langchain folder

Signed-off-by: letonghan <letong.han@intel.com>

* support dataprep with llama_index

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add e2e test script

Signed-off-by: letonghan <letong.han@intel.com>

* update test script name

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Support Embedding Microservice with Llama Index (#150)

* fix stream=false doesn't work issue

Signed-off-by: letonghan <letong.han@intel.com>

* support embedding comp with llama_index

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add More Contents to the Table of MicroService (#141)

* Add More Contents to the Table MicroService

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* reorder

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* Update README.md

* refine structure

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix model

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* refine table

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* put llm to the ground

Signed-off-by: zehao-intel <zehao.huang@intel.com>

---------

Signed-off-by: zehao-intel <zehao.huang@intel.com>
Co-authored-by: Sihan Chen <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Use common security content for OPEA projects (#151)

* add python coverage

Signed-off-by: chensuyue <suyue.chen@intel.com>

* docs update

Signed-off-by: chensuyue <suyue.chen@intel.com>

* Revert "add python coverage"

This reverts commit 69615b16c8e7483f9fea742d1d3fa0707075a394.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* Enable vLLM Gaudi support for LLM service based on officially habana vllm release (#137)

Signed-off-by: tianyil1 <tianyi.liu@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

* support embedding comp with llama_index

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add test script for embedding llama_inde

Signed-off-by: letonghan <letong.han@intel.com>

* remove conflict requirements

Signed-off-by: letonghan <letong.han@intel.com>

* update test script

Signed-off-by: letonghan <letong.han@intel.com>

* udpate

Signed-off-by: letonghan <letong.han@intel.com>

* update

Signed-off-by: letonghan <letong.han@intel.com>

* update

Signed-off-by: letonghan <letong.han@intel.com>

* fix ut issue

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: tianyil1 <tianyi.liu@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: zehao-intel <zehao.huang@intel.com>
Co-authored-by: Sihan Chen <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Tianyi Liu <tianyi.liu@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Support Ollama microservice (#142)

* Add Ollama Support

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Fix dataprep microservice path issue (#163)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* update CI to support dataprep_redis path level change (#155)

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Add Gateway for Translation (#169)

* add translation gateway

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* fix import

Signed-off-by: zehao-intel <zehao.huang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: zehao-intel <zehao.huang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Update LLM readme (#172)

* Update LLM readme

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update readme

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update tgi readme

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* rollback requirements.txt

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* add milvus microservice (#158)

* Use common security content for OPEA projects (#151)

* add python coverage

Signed-off-by: chensuyue <suyue.chen@intel.com>

* docs update

Signed-off-by: chensuyue <suyue.chen@intel.com>

* Revert "add python coverage"

This reverts commit 69615b16c8e7483f9fea742d1d3fa0707075a394.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: jinjunzh <jasper.zhu@intel.com>

* add milvus microservice

Signed-off-by: jinjunzh <jasper.zhu@intel.com>

* fix the typo

Signed-off-by: jinjunzh <jasper.zhu@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Signed-off-by: jinjunzh <jasper.zhu@intel.com>

---------

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: jinjunzh <jasper.zhu@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* enable python coverage (#149)

Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Add Ray version for multi file process (#119)

* add ray version document to redis

Signed-off-by: Chendi Xue <chendi.xue@intel.com>

* update test

Signed-off-by: Chendi Xue <chendi.xue@intel.com>

* Add test

Signed-off-by: Chendi Xue <chendi.xue@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add TIMEOUT in container environment and return status

Signed-off-by: Chendi Xue <chendi.xue@intel.com>

* rebase on new folder layout

Signed-off-by: Chendi Xue <chendi.xue@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Add codecov (#178)

Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Rename lm-eval folder to utils/lm-eval (#179)

Signed-off-by: changwangss <chang1.wang@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Support rerank and retrieval of RAG OPT (#164)

* supported bce model for rerank.

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>

* change folder

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* change path in test file.

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>

---------

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Support vLLM XFT LLM microservice (#174)

* Support vLLM XFT serving

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix access vllm issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add permission for run.sh

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add readme

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix proxy issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Update Dataprep Microservice README (#173)

* update dataprep readme

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fixed milvus port conflict issues during deployment (#183)

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fixed milvus port conflict issues during deployment

* align port for unified retrieval microservice

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* remove

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* remove hard address

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update readme

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* add example data and ingestion

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix typ

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix dataprep timeout issue (#203)

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* Add a new embedding MosecEmbedding (#182)

* Add a new embedding MosecEmbedding.

Signed-off-by: Jincheng Miao <jincheng.miao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Jincheng Miao <jincheng.miao@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* expand timeout for microservice test (#208)

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix typo

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix requirement

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: zehao-intel <zehao.huang@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: tianyil1 <tianyi.liu@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: jinjunzh <jasper.zhu@intel.com>
Signed-off-by: Sun, Xuehao <xuehao.sun@intel.com>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: changwangss <chang1.wang@intel.com>
Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>
Signed-off-by: Jincheng Miao <jincheng.miao@intel.com>
Co-authored-by: XuhuiRen <44249229+XuhuiRen@users.noreply.github.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: Sihan Chen <39623753+Spycsh@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: zehao-intel <zehao.huang@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: Tianyi Liu <tianyi.liu@intel.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Co-authored-by: jasperzhu <jasper.zhu@intel.com>
Co-authored-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: Sun, Xuehao <xuehao.sun@intel.com>
Co-authored-by: Wang, Chang <491521017@qq.com>
Co-authored-by: XinyuYe-Intel <xinyu.ye@intel.com>
Co-authored-by: Jincheng Miao <jincheng.miao@intel.com>
2024-06-20 17:16:01 +08:00