Commit Graph

235 Commits

Author SHA1 Message Date
XinyaoWa
7bf1953c23 Embedding compatible with OpenAI API (#892)
* Embedding TEI Langchain compatible with OpenAI API

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* TextDoc support list

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* support tei llama index openai compatible API

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* support mosec langchain openai compatible API

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* update UT for embedding tests

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix ut bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* support embedding predictionguard  openai compatible API

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* support embedding multimodal clip OpenAI compatible API

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* enable debug mode for embedding UT

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
2024-11-14 09:29:36 +08:00
Mustafa
baafa402c2 Add support for Audio and Video summarization to Docsum (#865)
* v2a services

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* add a2t - llm

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update whisper serve

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* updates

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* add data service

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* gateway

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* clean gateway & orchestrator

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* updates

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* updates

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* adding functional tests

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* updates

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* updates

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* updates read me file

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* name changes

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update readme file

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update readme file

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update readme file

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update readme file

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update readme file

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update max token option

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the test files

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* readme updtes

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* readme updtes

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* clean code

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update dataprep-compose-cd.yaml file

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* merge and sync

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* merge and sync gateway

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* adding the copyright header

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update the end of file char

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update gateway

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update gateway-docsum

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix test files

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* fix test files

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* merge & sync

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* Update dataprep-compose.yaml

* update test

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

* update dataprep-compose

Signed-off-by: Mustafa <mustafa.cetin@intel.com>

---------

Signed-off-by: Mustafa <mustafa.cetin@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
2024-11-12 21:51:45 -08:00
lkk
e39b08f3d0 agent short & long term memory with langgraph. (#851)
* draft a demo code for memory.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add agent short-term memory with langgraph checkpoint.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add save long-term memory func.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add save long-term memory func.

* add timeout for llm response.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix ut with adding -e HABANA_VISIBLE_DEVICES=all.

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-11-12 17:28:37 +08:00
XinyuYe-Intel
37f35140cc Add DPO support in finetuning microservice (#857)
* added dpo support.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* make dpo trainer compatible with newest transformers.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* added ut for dpo.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* added training successfulness check in finetuning ut.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* updated broken link.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

---------

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
2024-11-12 11:35:03 +08:00
senhui2intel
52757b382c Enable Intel ARC gpu test for vllm openvino. (#856)
Signed-off-by: senhui2intel <senhui.zhang@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
2024-11-08 22:38:27 +08:00
XinyaoWa
617e119f67 Remove useless vllm ray (#859)
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
2024-11-08 13:04:19 +08:00
Melanie Hart Buehler
29ef64269a MultimodalQnA Image and Audio Support Phase 1 (#852)
* Adds an endpoint for image ingestion

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* Combined image and video endpoint

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* Add test and update README

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* fixed variable name for embedding model (#1)

Signed-off-by: okhleif-IL <omar.khleif@intel.com>

* Fixed test script

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* Remove redundant function

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* get_videos, delete_videos --> get_files, delete_files (#3)

Signed-off-by: okhleif-IL <omar.khleif@intel.com>

* Updates test per review feedback

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* Fixed test

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* Add support for audio files multimodal data ingestion (#4)

* Add support for audio files multimodal data ingestion

Signed-off-by: dmsuehir <dina.s.jones@intel.com>

* Update function name

Signed-off-by: dmsuehir <dina.s.jones@intel.com>

---------

Signed-off-by: dmsuehir <dina.s.jones@intel.com>

* Change videos_with_transcripts to ingest_with_text

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* Add image support to video ingestion with transcript functionality

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* Update test and README

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* Updated for review suggestions

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* Add two tests for ingest_with_text

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>

* LVM TGI Gaudi update for prompts without images (#7)

* LVM Gaudi TGI update for prompts without images

Signed-off-by: dmsuehir <dina.s.jones@intel.com>

* Wording

Signed-off-by: dmsuehir <dina.s.jones@intel.com>

* Add a test

Signed-off-by: dmsuehir <dina.s.jones@intel.com>

---------

Signed-off-by: dmsuehir <dina.s.jones@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Change dummy image to be b64 encoded instead of the url (#9)

Signed-off-by: dmsuehir <dina.s.jones@intel.com>

* Updates based on review feedback (#10)

Signed-off-by: dmsuehir <dina.s.jones@intel.com>

* Test fix (#11)

Signed-off-by: dmsuehir <dina.s.jones@intel.com>

---------

Signed-off-by: Melanie Buehler <melanie.h.buehler@intel.com>
Signed-off-by: okhleif-IL <omar.khleif@intel.com>
Signed-off-by: dmsuehir <dina.s.jones@intel.com>
Co-authored-by: dmsuehir <dina.s.jones@intel.com>
Co-authored-by: Omar Khleif <omar.khleif@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Abolfazl Shahbazi <12436063+ashahba@users.noreply.github.com>
2024-11-08 10:19:46 +08:00
XinyaoWa
786cabe57d align vllm hpu version to latest vllm-fork (#860)
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
2024-11-07 14:14:58 +08:00
lvliang-intel
618f45bab1 Upgrade habana docker version to 1.18.0 (#854)
* Upgrade habana docker version to 1.18.0

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix issues

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix ci issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
2024-11-07 11:28:48 +08:00
Sihan Chen
518cdfb6e3 add dynamic batching embedding/reranking (#774)
* draft static batching embedding/reranking on single gaudi card

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

* resolve segfault, deadlock and other issues

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* narrow down default timeout

* add doockerfile

* fix hpu local microservice start

* openai format

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* configurable timeout

* lower timeout

* fix

* lower default timeout

* bf16

* log, pad max_len

* autocast, 128

* fix acc issue

* perf fallback with no acc drop

* revert no-padding ones

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix hpu graph wrapper

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add padding batch

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* habana 1.18

* static -> dynamic

* add UT, add param in_single_process

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add docker file

* fix case doc empty, and pass model id from env

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* CI

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
2024-11-06 16:13:36 +08:00
Yao Qing
a8e5adc4d0 [Exporter Tool] Updated exporter tool for docker compose and k8s manifests. (#813)
* Support convert mega.yaml to docker compose yaml.

* Remove device option in opea mege exporter.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* updated manifests exporter

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* updated manifests_exporter.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* updated mega.yaml & updated manifests_exporter

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* done

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* cleancode

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* cleancode and refactor to function

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* added UT for manifests

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix for UT.

* fixed the UT issue.

* merged to one file.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Zhenzhong1 <zhenzhong.xu@intel.com>
2024-11-06 10:34:04 +08:00
Eero Tamminen
a6998a1dbd Add E2E Promeheus metrics to applications (#845)
* Fix typos in BaseStatistics method names

Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>

* Add HttpService "inprogress" (pending) request count metrics

Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>

* Add E2E Prometheus metrics to ServiceOrchestrator

Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>

* Fix: support metrics with multiple ServiceOrchestrator instances

Unlike apps, CI tests create multiple of them.

Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>

* Fix: require named MicroService -> HTTPService instances

Creating multiple MicroService()s creates multiple HTTPService()s
which creates multiple Prometheus fastapi instrumentor instances.

While latter handled that fine for ChatQnA and normal HTTP metrics,
that was not the case for its "inprogress" metrics in CI.

Therefore MicroService constructor name argument is now mandatory, so
that it can be used to make "inprogress" metrics for HTTPService
instances unique.

PS. instrumentor requires HTTPService instance specific Starlette
instance, so it cannot be made singleton.

Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>

* Fix: update test_token_generator()

Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-11-04 09:58:23 +08:00
minmin-intel
c8e363901a Update RAGAgentLlama and ReActLlama (#843)
* use ChatOpenAI to interface with TGI-gaudi

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update tools for unit test

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update readme and test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix test script

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* consolidate chat model setup

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update tests and readme

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert react llama output parser

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-11-01 15:40:14 -07:00
Dan
d2e9c0a9dd Pinecone retriever index fix (#816)
* Update huggingface endpoint api

Replace deprecated HuggingFace Embeddings class.

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* Change timeout strategy launching retriever

Use wait-for-it script rather than an arbitrarily determined sleep.
This should be more resilient to timing variances both saving time
vs unnecessarily long sleeps and avoiding spurious failures if
CI is slow causing a container to take longer than normal to start.

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* Supress irrelevant warning during docker build

This path warning during docker build is not relevant.

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* Fix Pinecone service using ServerlessSpec index

Pinecone requires a hosted index.
That index can be a ServerlessSpec instance at a CSP or a more expensive
PodSpec based instance also hosted at a CSP.

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* Recreate index each run

For CI we need the index to be removed so the tests can be rerun
from a clean state.

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Dan Middleton <dan.middleton@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-30 21:35:16 +08:00
rbrugaro
19330ea23f GraphRAG with llama-index (#793)
* graphRAG dataprep llama-index validated w openai endpoints

Signed-off-by: rbrugaro <rita.brugarolas.brufau@intel.com>

* llama-index graphRAG retrieval validated with openai models

Signed-off-by: rbrugaro <rita.brugarolas.brufau@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* validated code usng TGI/TEI instead of openai

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* compose.yaml for dataprep validated with neo4j, TGI/TEI, openai

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* graphRAG retriever validated and full compose.yaml

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* minor fix

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add graphRAGGateway WIP

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* graphragGateway working in E2E Example

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* fix schedule in orchestrator to support ChatCompletionRequest input

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* change default to TGI instead of openAI and add test code for neo4jretriever

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* test code for dataprep-neo4j microservice

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* improved READMES

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update docker build path for tests

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* minor fix

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* fix typo in container name

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* resolve image name conflict for hub publishing

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* add tgi validation to miicroservice tests

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* rename test script to trigger cicd correctly w hpu

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* rename test containers for cicd

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* update HF_TOKEN in TGI/TEI test scripts

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* swaped larger model so the graph isnt empty in ci test

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* set 4 hpu for 70B model in ci test

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* add extra time for large model loading cicd

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* fix tgi gaudi shard args

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* switch to chat cause chat template is needed

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* enable logs in test

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* use locally downloaded model in CI machine

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* use local model path and reduce wait time

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* clear ports before ci run

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* fix cache model access

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* fix cache model access

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* incrased wait time for tgi shards ready

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* wait until tgi connected

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* switch back to small model for testing

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* minor readability fixes

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

* README fixes

Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>

---------

Signed-off-by: rbrugaro <rita.brugarolas.brufau@intel.com>
Signed-off-by: Rita Brugarolas <rita.brugarolas.brufau@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-29 22:45:44 -07:00
Sihan Chen
02c3dfe3bf fix pydantic BaseModel in/out in dataflow (#818)
* fix protocol in/out supported types

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-23 10:22:13 +08:00
Chendi.Xue
3473bfb38b [Agent] support custom prompt (#798)
* habana_main issue fixed, now use original dockerfile

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* Enable custom_prompt

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update README

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

---------

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-22 19:26:32 +08:00
XinyuYe-Intel
52c1826fb9 Add image2image microservice (#794)
* added image2image microservice.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* added UT.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-22 15:49:58 +08:00
Chun Tao
aea7364d4e Move Wav2Lip model download commands from Dockerfiles to entrypoint.sh (#811)
* Update audioqna gateway to print text, in gateway.py

Signed-off-by: Chun Tao <chun.tao@intel.com>

* updates needed for demo

Signed-off-by: Chun Tao <chun.tao@intel.com>

* original pr content

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Revert "updates needed for demo"

This reverts commit f0c7a026305ace410610c9dba771699e13dde8ea.

Signed-off-by: Chun Tao <chun.tao@intel.com>

* remove improper images

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Addressed some comments on previous pr

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Add Dockerfile for cpu support

Signed-off-by: Chun Tao <chun.tao@intel.com>

* CODEOWNER: Update comp CODEOWNER (#757)

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>

* Add stable diffusion microservice (#729)

* add stable diffusion microservice.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* added test.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* changed output to images bytes data

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* unified inference and wrapper into one microservice.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix test.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

---------

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>

* Compatible with different platforms. (#766)

* Compatible with different platforms.

Signed-off-by: ZePan110 <ze.pan@intel.com>

* Fix issue.

Signed-off-by: ZePan110 <ze.pan@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix issue

Signed-off-by: ZePan110 <ze.pan@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>

* Optimize path and link validity check. (#745)

Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>

* Add timeout for ut test (#773)

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test hyperlink

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test hyperlink

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test hyperlink issue

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test hyperlink issue

Signed-off-by: Chun Tao <chun.tao@intel.com>

* put back hyperlinks in readme

Signed-off-by: Chun Tao <chun.tao@intel.com>

* remove possible error hyperlink

Signed-off-by: Chun Tao <chun.tao@intel.com>

* put hyperlink back

Signed-off-by: Chun Tao <chun.tao@intel.com>

* major update to use FastAPI for wav2lip, and structure component format

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add dockerfiles in animation-compose-cd.yaml

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Fix end of file issue in animation-compose-cd.yaml

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Fix Docker deployment on Xeon

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add versioning for all pip packages

Signed-off-by: Chun Tao <chun.tao@intel.com>

* e2e test script for animation

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update e2e test script

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update e2e test script

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update readme

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* udpate gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Fix AVATAR_CHATBOT

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* fix max_tokens in AvatarChatbot gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Model download script moved from Dockerfiles to Docker entrypoint

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update paths

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Correct paths in readme

Signed-off-by: Chun Tao <chun.tao@intel.com>

* revert changes to audioqna gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* longer wait time after docker run

Signed-off-by: Chun Tao <chun.tao@intel.com>

* add mount volume in test scripts

Signed-off-by: Chun Tao <chun.tao@intel.com>

* add volume mount in test scripts

Signed-off-by: Chun Tao <chun.tao@intel.com>

* udpate test script

Signed-off-by: Chun Tao <chun.tao@intel.com>

---------

Signed-off-by: Chun Tao <chun.tao@intel.com>
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: Hoong Tee, Yeoh <hoong.tee.yeoh@intel.com>
Co-authored-by: XinyuYe-Intel <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
2024-10-22 10:32:43 +08:00
Chun Tao
c26d37e709 Initiate "animation" component (#775)
* updates needed for demo

Signed-off-by: Chun Tao <chun.tao@intel.com>

* original pr content

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Revert "updates needed for demo"

This reverts commit f0c7a026305ace410610c9dba771699e13dde8ea.

Signed-off-by: Chun Tao <chun.tao@intel.com>

* remove improper images

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Addressed some comments on previous pr

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Add Dockerfile for cpu support

Signed-off-by: Chun Tao <chun.tao@intel.com>

* CODEOWNER: Update comp CODEOWNER (#757)

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>

* Add stable diffusion microservice (#729)

* add stable diffusion microservice.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* added test.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* changed output to images bytes data

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* unified inference and wrapper into one microservice.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix test.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

---------

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>

* Compatible with different platforms. (#766)

* Compatible with different platforms.

Signed-off-by: ZePan110 <ze.pan@intel.com>

* Fix issue.

Signed-off-by: ZePan110 <ze.pan@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix issue

Signed-off-by: ZePan110 <ze.pan@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>

* Optimize path and link validity check. (#745)

Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>

* Add timeout for ut test (#773)

Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test hyperlink

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test hyperlink

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test hyperlink issue

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test hyperlink issue

Signed-off-by: Chun Tao <chun.tao@intel.com>

* put back hyperlinks in readme

Signed-off-by: Chun Tao <chun.tao@intel.com>

* remove possible error hyperlink

Signed-off-by: Chun Tao <chun.tao@intel.com>

* put hyperlink back

Signed-off-by: Chun Tao <chun.tao@intel.com>

* major update to use FastAPI for wav2lip, and structure component format

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Add dockerfiles in animation-compose-cd.yaml

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Fix end of file issue in animation-compose-cd.yaml

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Fix Docker deployment on Xeon

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add versioning for all pip packages

Signed-off-by: Chun Tao <chun.tao@intel.com>

* e2e test script for animation

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update e2e test script

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update e2e test script

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update readme

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* udpate gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* Fix AVATAR_CHATBOT

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* fix max_tokens in AvatarChatbot gateway

Signed-off-by: Chun Tao <chun.tao@intel.com>

* test

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* update

Signed-off-by: Chun Tao <chun.tao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Chun Tao <chun.tao@intel.com>
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: Hoong Tee, Yeoh <hoong.tee.yeoh@intel.com>
Co-authored-by: XinyuYe-Intel <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
2024-10-21 15:52:24 +08:00
Daniel De León
5bb4046b34 Add WildGuard Guardrail Microservice (#710)
* add wildguard microservice

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* fix paths for wildguard dir

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* add README

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* add wildguard to guardrail README table

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* updates per code review

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update tokens

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* fix endpoint for testing

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* fixed formating

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* add more description of wildguard to distinguish from llamaguard

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

---------

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Co-authored-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
2024-10-11 12:10:15 -07:00
Dan
367b3aa5db Remove unused imports across all comps (#762)
* Remove unused imports across all comps

Linting was configured to ignore unused imports.
Remove this accumulation of lint.

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* Explain why we ignore unused imports with ruff

In general unused imports should be removed, but ruff can't and probably
shouldn't automatically fix conditional imports. Consequently,
conditional imports will always be left over causing false
positive errors in CI.

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* Revert pinecone import changes

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Dan Middleton <dan.middleton@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-11 22:11:59 +08:00
bjzhjing
84374a5710 Refactor milvus dataprep and retriever (#728)
* milvus: Refactor embedding settings for mivlus dataprep and retriever

Milvus dataprep and retriever leverage the same embedding enpoints, but
the embedding-related code is somewhat messed up, unify the namings and
logic to improve code readability and facilitate user-friendly
configuration.

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>

* MOSEC: Rename EMB_MODEL env as MOSEC_EMBEDDING_MODEL

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>

* milvus/dataprep: Update README for milvus dataprep

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>

* Add OCR package for Milvus dataprep

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>

* Update Milvus dataprep test script

This is to fix the CI issue for MILVUS environment variable name is
update.

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-09 23:57:19 -07:00
Abolfazl Shahbazi
9e85b35b0b Remove proxy definition from within Dockerfiles (#778)
Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
2024-10-10 12:00:32 +08:00
Abolfazl Shahbazi
4f5010cfbb add 'no-cache-dir' to all pip installs (#777)
* add 'no-cache-dir' to all pip installs

Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>

* Fix a malformed line break

Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>

---------

Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
2024-10-10 11:09:47 +08:00
XinyuYe-Intel
5d0c436704 Add stable diffusion microservice (#729)
* add stable diffusion microservice.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* added test.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* changed output to images bytes data

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* unified inference and wrapper into one microservice.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix test.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

---------

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-08 14:13:52 +08:00
Chendi.Xue
4638c1d45d Enable vllm for Agent (#752)
* Update Agent vllm client codes and test

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* Update README with vllm related update

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove unnecessary env

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* support plan_execute with vllm

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* Update README and test llama vllm support

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update vllm_port to 8086 avoid conflict

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

---------

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-01 10:44:14 -07:00
lvliang-intel
534c227a6e Support Llama3.2 vision and vision guard model (#753)
* Support llama3.2 models

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix issues

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update code and doc

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add llama vision guard support

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add llama guard prompt format utils

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add tp support

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add wheel

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix accuracy issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update tp service code

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update dockerfile

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* support lvm tp serving

Signed-off-by: letonghan <letong.han@intel.com>

* update dockerfile

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add run tp script

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix max_new_tokens

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update run tp script

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* refine code and doc

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* install transformers from local wheel

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update  code using official transformers

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* remove unnecessary code

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove blank line

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix precommit issues

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix cd issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-30 17:27:41 +09:00
minmin-intel
bece9f4f03 Fix tool_render with direct import from pydantic (#750)
* fix tool renderer bug

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* clean up test script

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* switch to pydantic direct import

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-28 15:37:33 +08:00
chen, suyue
c4f9083c80 Fix image build (#737)
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-09-27 15:37:17 +08:00
ZePan110
ad8bd4f6f8 Change port for avoid port conflicts. (#747)
Signed-off-by: ZePan110 <ze.pan@intel.com>
2024-09-27 12:17:10 +08:00
Yogesh Pandey
827e3d400d Text to SQL microservice (#736)
* Initial Version of TextToSQL

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* Updated Code to add more metadata in the reply

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* Updated DockerFile

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* UpdatedREADME

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fixed precommit CIs

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Updated yaml files

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* Updated tests to use the right directory

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* Updated tests to use the right env

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* Updates as per review comments | fixed README and requirements.txt

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Added changed as per review comments

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Yogesh <yogeshpandey@intel.com>
Co-authored-by: Yogesh <yogeshpandey@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-26 23:22:25 +08:00
minmin-intel
e7fdf53745 Add RAG agent and ReAct agent implemention for llama3.1 served by TGI-gaudi (#722)
* add ragagent and react agent for llama3.1

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update ut

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* debug ut

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update test and readme

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update ragagent llama docgrader

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-26 22:10:44 +08:00
shaohef
e588b9fca0 change prompt usvc prot to 6018 (#740)
Signed-off-by: Shaohe Feng <shaohe.feng@intel.com>
2024-09-26 14:32:03 +08:00
Sharan Shirodkar
4bbc7a2f55 Prediction Guard Guardrails components (#677)
* added files for PG guardrails components

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Fix pre-commit issues: end-of-file, requirements.txt, trailing whitespace, imports, and formatting

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* file structure updated to latest

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Fix pre-commit issues: end-of-file, requirements.txt, trailing whitespace, imports, and formatting

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Add .DS_Store to .gitignore

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* updated readme,requirements+changes based on feedback

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* references classes in init.py

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Fix pre-commit issues: end-of-file, requirements.txt, trailing whitespace, imports, and formatting

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* removed duplicatesa

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* removed added readme content

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

---------

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>
2024-09-23 16:14:57 +08:00
XinyuYe-Intel
a03e7a559c Add image2video microservice (Stable Video Diffusion) (#465)
* added image2video microservice.

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* addition changes.

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>

* minor changes

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>

* added ut test

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* unified path.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* added gaudi support for svd.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix bug

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix ut

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* add docker image release file

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

---------

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: kevinintel <hanwen.chang@intel.com>
2024-09-23 14:25:56 +08:00
qgao007
e29865e755 Add E2E test for bias detection of guardrails (#708)
* Add Bias Detection Microservice

Signed-off-by: Qun Gao <qun.gao@intel.com>

* Add E2E test for bias detection

Signed-off-by: Qun Gao <qun.gao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Qun Gao <qun.gao@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-19 09:22:52 +08:00
XinyaoWa
3a31295ef8 Align parameters for "max_token, repetition_penalty,presence_penalty,frequency_penalty" (#608)
* align max_tokens

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* aligin repetition_penalty

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* align penalty parameters

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* align max_tokens

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* debug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* debug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix langchain version bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* fix langchain version bug

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: kevinintel <hanwen.chang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
2024-09-18 20:39:23 +08:00
chen, suyue
3d00a33e09 update image build compose (#698)
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-18 11:11:59 +08:00
Sharan Shirodkar
1249c4fe72 Prediction Guard LVM component (#676)
* added files for PG lvm component

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Fix pre-commit issues: end-of-file, requirements.txt, trailing whitespace, imports, and formatting

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

---------

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>
2024-09-18 10:32:16 +08:00
liuzhenwei
2e41dcf960 Support Llama index for vLLM native (#692)
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
2024-09-18 07:12:44 +08:00
Sharan Shirodkar
391c4a5801 Prediction Guard LLM component (#674)
Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>
2024-09-17 21:57:06 +08:00
Sharan Shirodkar
191061b642 Prediction Guard embeddings component (#675)
* added files for PG embeddingso component

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fixed dockerfile link

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Fix pre-commit issues: end-of-file, requirements.txt, trailing whitespace, imports, and formatting

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fixed embedoc call

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* file structure updated to latest

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Fix pre-commit issues: end-of-file, requirements.txt, trailing whitespace, imports, and formatting

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

---------

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>
2024-09-17 21:33:19 +08:00
XuhuiRen
29fe569d34 Enable GraphRAG with Neo4J (#682)
* add graphrag for neo4j

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>

* add

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>

* fix ut

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>

* fix

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>

* add

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update retriever_neo4j.py

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>

* Update test_retrievers_neo4j_langchain.sh

* add

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>

* Update test_retrievers_neo4j_langchain.sh

* Update test_retrievers_neo4j_langchain.sh

* Update test_retrievers_neo4j_langchain.sh

* add docker

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>

* Update retrievers-compose-cd.yaml

* Update test_retrievers_neo4j_langchain.sh

* Update config.py

* Update test_retrievers_neo4j_langchain.sh

* Update test_retrievers_neo4j_langchain.sh

* Update config.py

* Update test_retrievers_neo4j_langchain.sh

* Update requirements.txt

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update requirements.txt

* Update requirements.txt

* Update requirements.txt

---------

Signed-off-by: XuhuiRen <xuhui.ren@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
2024-09-15 18:12:29 +08:00
lvliang-intel
574fecfe77 Update embedding svc test port number (#688)
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
2024-09-13 17:35:15 +08:00
Tiep Le
2ca56f3ed9 Update example name into MultimodalQnA and update image names (#686)
* update image names

Signed-off-by: Tiep Le <tiep.le@intel.com>

* update image names for dataprep service

Signed-off-by: Tiep Le <tiep.le@intel.com>

* update image name for retriever

Signed-off-by: Tiep Le <tiep.le@intel.com>

* update image name for lvm

Signed-off-by: Tiep Le <tiep.le@intel.com>

* update lvm include caption in output

Signed-off-by: Tiep Le <tiep.le@intel.com>

* update gateway name into MultimodalQnAGateway

Signed-off-by: Tiep Le <tiep.le@intel.com>

* update test gateway for rename

Signed-off-by: Tiep Le <tiep.le@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Tiep Le <tiep.le@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-13 17:07:38 +08:00
Huiling Bao
2b68323c2c Rename videoragqna to videoqna to align with other examples (#680)
Signed-off-by: BaoHuiling <huiling.bao@intel.com>
2024-09-12 22:12:39 +08:00
chen, suyue
6ce65514e1 replace langchain/langchain:latest with python:3.11-slim (#669)
* replace langchain/langchain:latest with python:3.11-slim

Signed-off-by: chensuyue <suyue.chen@intel.com>

* fix test

Signed-off-by: chensuyue <suyue.chen@intel.com>

---------

Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-09-12 13:24:50 +08:00
lvliang-intel
1b6989797f Add OpenAI client access OPEA microservice UT cases (#653)
* Add OpeanAI access microservice UT cases

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add the absolute path

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* refactor code

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add openai denpendency

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* install openai in scripts

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix ci issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-12 00:08:14 +08:00
lvliang-intel
cff0a4dfbb Support export megaservice yaml to docker compose file (#642)
* Support export megaservice yaml tp docker compose file

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add ut case

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add code spell ignore

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix ut issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* disable cli case

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-11 22:26:43 +08:00