Commit Graph

683 Commits

Author SHA1 Message Date
Sihan Chen
ca4cf91b5c add docker and readme for asr/tts microservices (#31)
* add docker and readme for asr/tts microservices

* fix typo

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
2024-05-09 15:41:50 +08:00
Letong Han
eab6e56011 Fix variables issues of Reranking Microservice (#32)
* fix variables and readme issue

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-05-09 15:36:22 +08:00
chen, suyue
bdffd11785 Support megaservice ut in CI test (#13)
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
2024-05-09 13:51:05 +08:00
lvliang-intel
b7bce38669 Add docker and readme for rerank and guardrails microservice (#30)
* Add docker for Rerank and Guardrails microservice

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update readme

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-05-09 13:46:01 +08:00
Sihan Chen
ead258069c Enable adding remote micro-service in distributed environment (#28)
* Enable adding remote micro-service in distributed environment

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix redis config import issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update requirements.txt

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
2024-05-09 11:34:20 +08:00
Sihan Chen
a04359c222 Add OpenTelemetry (#24)
* add OpenTelemetry

* req

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* clean

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-05-08 19:27:34 +08:00
Letong Han
2c17d7ba87 Add docker and readme for LLM Microservice (#29)
* add LLM docker and readme

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-05-08 19:27:01 +08:00
Letong Han
617065ccdb Add Dockerfile for Retriever Microservice (#26)
* add docker & readme for embedding service

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add dockerfile for retriever microservice

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add readme & modify docker folder path

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* move docker folder of embedding

Signed-off-by: letonghan <letong.han@intel.com>

* update image&container name

Signed-off-by: letonghan <letong.han@intel.com>

* update image name in readme

Signed-off-by: letonghan <letong.han@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-05-08 19:26:29 +08:00
lvliang-intel
aead3c953e Refine code structure (#27)
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
2024-05-08 17:55:37 +08:00
lvliang-intel
552ef164b2 Add ChatQnA workflow test using microservice pipeline (#23)
* Add ChatQnA microservice workflow test

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update llm for non-rag scenarion

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-05-08 14:21:19 +08:00
Letong Han
6a84533fe7 Add docker & readme for Embedding Microservice (#22)
* add docker & readme for embedding service

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-05-07 23:10:40 +08:00
Sihan Chen
0d1163617a Add asr and tts microservices (#20)
* add asr/tts microservices

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
2024-05-06 23:40:01 +08:00
Letong Han
6945aa7990 Add Retriever Microservice (#19)
* add retriever microservice

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add copyright

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
2024-05-06 23:05:23 +08:00
lvliang-intel
3bc899beb8 Add reranking microservice (#21)
* Add reranking microservice

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
2024-05-06 21:35:39 +08:00
lvliang-intel
1f6c1a5dea Add Guardrails and Embedding microservices (#15)
* Add Guardrails and Embedding microservices

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
2024-05-06 09:05:07 +08:00
Letong Han
3341e3fedf Add LLM microservice component (#10)
* add data type for llm

Signed-off-by: letonghan <letong.han@intel.com>

* add llm microservice

Signed-off-by: letonghan <letong.han@intel.com>

* add requirements

Signed-off-by: letonghan <letong.han@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update llm microservice

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
2024-05-06 08:39:26 +08:00
chen, suyue
00a7cc2323 update trellix scan (#18)
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-04-30 18:37:39 +08:00
chen, suyue
3a9a3de55d update code scan (#17)
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-04-30 17:29:28 +08:00
chen, suyue
80176c376e enable trellix for virus scan (#16)
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-04-30 16:52:23 +08:00
lvliang-intel
70bbe97720 Refine microservice flow and ut (#11)
* Refine microservice flow and ut

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix pylint

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix pylint

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix process termiante issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* rename service builder

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-04-30 10:26:31 +08:00
chen, suyue
32cba5271d add hadolint scan (#14)
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-04-29 15:41:06 +08:00
Letong Han
23a7288b20 [Data Layer] Add data layer and embedding component (#7)
* add data layer for microservices, add embedding example service

Signed-off-by: letonghan <letong.han@intel.com>

* refine the code structure

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix import path

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* refine code structure

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add ut

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* remove scheduler

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix __init__.py

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

---------

Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-04-26 21:21:09 +08:00
Sihan Chen
b3f83dda76 Add DAG flow (#9)
* add basic DAG flow

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* comment test code

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-04-26 20:12:34 +08:00
lvliang-intel
3f03be3544 Add service infrastructure (#8)
* Add MicroService Infrastructure

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* rename directory

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix ci issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix ci issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* refine microservice class

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-04-26 19:48:18 +08:00
Tianyi Liu
710a5fadfe Initially add the vllm support (#5)
* initially add the vllm support

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

* add the vllm readme

Signed-off-by: tianyil1 <tianyi.liu@intel.com>

---------

Signed-off-by: tianyil1 <tianyi.liu@intel.com>
2024-04-26 17:22:22 +08:00
chen, suyue
3ee3f40a37 add initial CI structure (#6)
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-04-26 13:38:23 +08:00
lvliang-intel
eb70a49780 Merge pull request #4 from opea-project/letong/microservice
Add HTTPService and AsyncLoop for microservice
2024-04-24 21:03:16 +08:00
letonghan
cd32055f11 base classes of microservice
Signed-off-by: letonghan <letong.han@intel.com>
2024-04-24 17:45:08 +08:00
Haihao Shen
69de47b02c Merge pull request #2 from opea-project/fix_typo
Fix the typo
2024-04-21 10:14:40 +08:00
hshen14
89bfe94c71 Fix the typo 2024-04-21 08:52:34 +08:00
Haihao Shen
b1c45a4c4a Merge pull request #1 from opea-project/lvl/code_structure
Add code structure
2024-04-21 08:50:10 +08:00
lvliang-intel
8b9cf63510 add code structure
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
2024-04-19 23:17:31 +08:00
Haihao Shen
a6ae5ee42a Initial commit 2024-04-19 18:43:47 +08:00