* Fix typos in BaseStatistics method names
Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>
* Add HttpService "inprogress" (pending) request count metrics
Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>
* Add E2E Prometheus metrics to ServiceOrchestrator
Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>
* Fix: support metrics with multiple ServiceOrchestrator instances
Unlike apps, CI tests create multiple of them.
Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>
* Fix: require named MicroService -> HTTPService instances
Creating multiple MicroService()s creates multiple HTTPService()s
which creates multiple Prometheus fastapi instrumentor instances.
While latter handled that fine for ChatQnA and normal HTTP metrics,
that was not the case for its "inprogress" metrics in CI.
Therefore MicroService constructor name argument is now mandatory, so
that it can be used to make "inprogress" metrics for HTTPService
instances unique.
PS. instrumentor requires HTTPService instance specific Starlette
instance, so it cannot be made singleton.
Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>
* Fix: update test_token_generator()
Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Eero Tamminen <eero.t.tamminen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* use ChatOpenAI to interface with TGI-gaudi
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* update tools for unit test
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update readme and test
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix test script
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* consolidate chat model setup
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update tests and readme
Signed-off-by: minmin-intel <minmin.hou@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* revert react llama output parser
---------
Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Add get_access_token method in utils.py to get the token for OAuth protected tgi and tei remote endpoints
* Update embedding_tei.py to support authentication for tei endpoints. Uses get_access_token from utils
* Update llm.py under llms faq-generation to support authentication for tgi endpoints. Uses get_access_token from utils
* Update llm.py under llms summarization to support authentication for tgi endpoints. Uses get_access_token from utils
* Update llm.py under llms text-generation to support authentication for tgi endpoints. Uses get_access_token from utils
* Update reranking_tei to support authentication for tgi endpoints. Uses get_access_token from utils
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Update huggingface endpoint api
Replace deprecated HuggingFace Embeddings class.
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
* Change timeout strategy launching retriever
Use wait-for-it script rather than an arbitrarily determined sleep.
This should be more resilient to timing variances both saving time
vs unnecessarily long sleeps and avoiding spurious failures if
CI is slow causing a container to take longer than normal to start.
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
* Supress irrelevant warning during docker build
This path warning during docker build is not relevant.
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
* Fix Pinecone service using ServerlessSpec index
Pinecone requires a hosted index.
That index can be a ServerlessSpec instance at a CSP or a more expensive
PodSpec based instance also hosted at a CSP.
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
* Recreate index each run
For CI we need the index to be removed so the tests can be rerun
from a clean state.
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* fix add doc batch size issue
Signed-off-by: letonghan <letong.han@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* simplify code
Signed-off-by: letonghan <letong.han@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Update audioqna gateway to print text, in gateway.py
Signed-off-by: Chun Tao <chun.tao@intel.com>
* updates needed for demo
Signed-off-by: Chun Tao <chun.tao@intel.com>
* original pr content
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Revert "updates needed for demo"
This reverts commit f0c7a026305ace410610c9dba771699e13dde8ea.
Signed-off-by: Chun Tao <chun.tao@intel.com>
* remove improper images
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Addressed some comments on previous pr
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Add Dockerfile for cpu support
Signed-off-by: Chun Tao <chun.tao@intel.com>
* CODEOWNER: Update comp CODEOWNER (#757)
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Add stable diffusion microservice (#729)
* add stable diffusion microservice.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* added test.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* changed output to images bytes data
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* unified inference and wrapper into one microservice.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix test.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
---------
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Compatible with different platforms. (#766)
* Compatible with different platforms.
Signed-off-by: ZePan110 <ze.pan@intel.com>
* Fix issue.
Signed-off-by: ZePan110 <ze.pan@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Fix issue
Signed-off-by: ZePan110 <ze.pan@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Optimize path and link validity check. (#745)
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Add timeout for ut test (#773)
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink issue
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink issue
Signed-off-by: Chun Tao <chun.tao@intel.com>
* put back hyperlinks in readme
Signed-off-by: Chun Tao <chun.tao@intel.com>
* remove possible error hyperlink
Signed-off-by: Chun Tao <chun.tao@intel.com>
* put hyperlink back
Signed-off-by: Chun Tao <chun.tao@intel.com>
* major update to use FastAPI for wav2lip, and structure component format
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Add dockerfiles in animation-compose-cd.yaml
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Fix end of file issue in animation-compose-cd.yaml
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Fix Docker deployment on Xeon
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add versioning for all pip packages
Signed-off-by: Chun Tao <chun.tao@intel.com>
* e2e test script for animation
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update e2e test script
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update e2e test script
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update readme
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* udpate gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Fix AVATAR_CHATBOT
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* fix max_tokens in AvatarChatbot gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Model download script moved from Dockerfiles to Docker entrypoint
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update paths
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Correct paths in readme
Signed-off-by: Chun Tao <chun.tao@intel.com>
* revert changes to audioqna gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* longer wait time after docker run
Signed-off-by: Chun Tao <chun.tao@intel.com>
* add mount volume in test scripts
Signed-off-by: Chun Tao <chun.tao@intel.com>
* add volume mount in test scripts
Signed-off-by: Chun Tao <chun.tao@intel.com>
* udpate test script
Signed-off-by: Chun Tao <chun.tao@intel.com>
* udpate optimizations
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* need outputs folder
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test
Signed-off-by: Chun Tao <chun.tao@intel.com>
---------
Signed-off-by: Chun Tao <chun.tao@intel.com>
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: Hoong Tee, Yeoh <hoong.tee.yeoh@intel.com>
Co-authored-by: XinyuYe-Intel <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
* add huggingface token for native llm
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix bug
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* fix bug
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
---------
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Support file upload summary for DocSum microservice
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add aiofiles
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* move file handlding in gateway
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* rollback docsum code
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* only import iin docsum
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* clean dependency
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* update code
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* refine codetrans prompt and parameter
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* support parameters input for codetrans
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* fix protocol in/out supported types
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* added image2image microservice.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* added UT.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Update audioqna gateway to print text, in gateway.py
Signed-off-by: Chun Tao <chun.tao@intel.com>
* updates needed for demo
Signed-off-by: Chun Tao <chun.tao@intel.com>
* original pr content
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Revert "updates needed for demo"
This reverts commit f0c7a026305ace410610c9dba771699e13dde8ea.
Signed-off-by: Chun Tao <chun.tao@intel.com>
* remove improper images
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Addressed some comments on previous pr
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Add Dockerfile for cpu support
Signed-off-by: Chun Tao <chun.tao@intel.com>
* CODEOWNER: Update comp CODEOWNER (#757)
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Add stable diffusion microservice (#729)
* add stable diffusion microservice.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* added test.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* changed output to images bytes data
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* unified inference and wrapper into one microservice.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix test.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
---------
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Compatible with different platforms. (#766)
* Compatible with different platforms.
Signed-off-by: ZePan110 <ze.pan@intel.com>
* Fix issue.
Signed-off-by: ZePan110 <ze.pan@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Fix issue
Signed-off-by: ZePan110 <ze.pan@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Optimize path and link validity check. (#745)
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Add timeout for ut test (#773)
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink issue
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink issue
Signed-off-by: Chun Tao <chun.tao@intel.com>
* put back hyperlinks in readme
Signed-off-by: Chun Tao <chun.tao@intel.com>
* remove possible error hyperlink
Signed-off-by: Chun Tao <chun.tao@intel.com>
* put hyperlink back
Signed-off-by: Chun Tao <chun.tao@intel.com>
* major update to use FastAPI for wav2lip, and structure component format
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Add dockerfiles in animation-compose-cd.yaml
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Fix end of file issue in animation-compose-cd.yaml
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Fix Docker deployment on Xeon
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add versioning for all pip packages
Signed-off-by: Chun Tao <chun.tao@intel.com>
* e2e test script for animation
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update e2e test script
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update e2e test script
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update readme
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* udpate gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Fix AVATAR_CHATBOT
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* fix max_tokens in AvatarChatbot gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Model download script moved from Dockerfiles to Docker entrypoint
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update paths
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Correct paths in readme
Signed-off-by: Chun Tao <chun.tao@intel.com>
* revert changes to audioqna gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* longer wait time after docker run
Signed-off-by: Chun Tao <chun.tao@intel.com>
* add mount volume in test scripts
Signed-off-by: Chun Tao <chun.tao@intel.com>
* add volume mount in test scripts
Signed-off-by: Chun Tao <chun.tao@intel.com>
* udpate test script
Signed-off-by: Chun Tao <chun.tao@intel.com>
---------
Signed-off-by: Chun Tao <chun.tao@intel.com>
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: Hoong Tee, Yeoh <hoong.tee.yeoh@intel.com>
Co-authored-by: XinyuYe-Intel <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
* updates needed for demo
Signed-off-by: Chun Tao <chun.tao@intel.com>
* original pr content
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Revert "updates needed for demo"
This reverts commit f0c7a026305ace410610c9dba771699e13dde8ea.
Signed-off-by: Chun Tao <chun.tao@intel.com>
* remove improper images
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Addressed some comments on previous pr
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Add Dockerfile for cpu support
Signed-off-by: Chun Tao <chun.tao@intel.com>
* CODEOWNER: Update comp CODEOWNER (#757)
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Add stable diffusion microservice (#729)
* add stable diffusion microservice.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* added test.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* changed output to images bytes data
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* unified inference and wrapper into one microservice.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix test.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
---------
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Compatible with different platforms. (#766)
* Compatible with different platforms.
Signed-off-by: ZePan110 <ze.pan@intel.com>
* Fix issue.
Signed-off-by: ZePan110 <ze.pan@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Fix issue
Signed-off-by: ZePan110 <ze.pan@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Optimize path and link validity check. (#745)
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Add timeout for ut test (#773)
Signed-off-by: chensuyue <suyue.chen@intel.com>
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink issue
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test hyperlink issue
Signed-off-by: Chun Tao <chun.tao@intel.com>
* put back hyperlinks in readme
Signed-off-by: Chun Tao <chun.tao@intel.com>
* remove possible error hyperlink
Signed-off-by: Chun Tao <chun.tao@intel.com>
* put hyperlink back
Signed-off-by: Chun Tao <chun.tao@intel.com>
* major update to use FastAPI for wav2lip, and structure component format
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* Add dockerfiles in animation-compose-cd.yaml
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Fix end of file issue in animation-compose-cd.yaml
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Fix Docker deployment on Xeon
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add versioning for all pip packages
Signed-off-by: Chun Tao <chun.tao@intel.com>
* e2e test script for animation
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update e2e test script
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update e2e test script
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update readme
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* udpate gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* Fix AVATAR_CHATBOT
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* fix max_tokens in AvatarChatbot gateway
Signed-off-by: Chun Tao <chun.tao@intel.com>
* test
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* update
Signed-off-by: Chun Tao <chun.tao@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Chun Tao <chun.tao@intel.com>
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Signed-off-by: ZePan110 <ze.pan@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: Hoong Tee, Yeoh <hoong.tee.yeoh@intel.com>
Co-authored-by: XinyuYe-Intel <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
* fix audio output
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* support Chinese for DocSum
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* refine readme for docsum
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
* [rerank]: Refine documentation for rerank comps
Restructure and refine README documentation for rerank components.
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* rerank-doc: Break up README lines for viewing experience
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
---------
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
* Remove unused imports across all comps
Linting was configured to ignore unused imports.
Remove this accumulation of lint.
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
* Explain why we ignore unused imports with ruff
In general unused imports should be removed, but ruff can't and probably
shouldn't automatically fix conditional imports. Consequently,
conditional imports will always be left over causing false
positive errors in CI.
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
* Revert pinecone import changes
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* milvus: Refactor embedding settings for mivlus dataprep and retriever
Milvus dataprep and retriever leverage the same embedding enpoints, but
the embedding-related code is somewhat messed up, unify the namings and
logic to improve code readability and facilitate user-friendly
configuration.
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
* MOSEC: Rename EMB_MODEL env as MOSEC_EMBEDDING_MODEL
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
* milvus/dataprep: Update README for milvus dataprep
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
* Add OCR package for Milvus dataprep
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
* Update Milvus dataprep test script
This is to fix the CI issue for MILVUS environment variable name is
update.
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Async support for some microservices
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix issues
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* fix issues
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* fix import issue
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* add dependency library
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* fix issue
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* roll back pinecone change
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* add stable diffusion microservice.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* added test.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* changed output to images bytes data
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* unified inference and wrapper into one microservice.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* fix test.
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
---------
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* 🐛 bugfix: Retrieval on llm-vllm service not working
Signed-off-by: Krishna Murti <krishna.murti@intel.com>
* removed LLMParamDocs instantiation
Signed-off-by: Krishna Murti <krishna.murti@intel.com>
* applied patch for recent updates for llm-vllm
Signed-off-by: Krishna Murti <krishna.murti@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Krishna Murti <krishna.murti@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Update Agent vllm client codes and test
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
* Update README with vllm related update
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* remove unnecessary env
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
* support plan_execute with vllm
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
* Update README and test llama vllm support
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* update vllm_port to 8086 avoid conflict
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
---------
Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Minor code refactor
Remove unused import, unused variables and enhance docstring of code.
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
* text-to-sql: Refine documentation
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
* [text-to-sql]: Restructure README documentation
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
* Remove unused imports
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
* Remove unused imports
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
* [pre-commit.ci] auto fixes from pre-commit.com hooks
for more information, see https://pre-commit.ci
---------
Signed-off-by: Dan Middleton <dan.middleton@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
