Commit Graph

666 Commits

Author SHA1 Message Date
chen, suyue
27101159bc revert test code (#800)
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-10-17 14:19:40 +08:00
lvliang-intel
2f0d78e504 Add dataprep endpoint in nginx microservice (#795)
Signed-off-by: lvliang-intel <liang1.lv@intel.com>
2024-10-16 17:43:53 +08:00
Harsha Ramayanam
c6dfeb0a2d Changes to comps/llms/text-generation/README.md (#783)
* Removed redundant commands

Signed-off-by: Harsha Ramayanam <harsha.ramayanam@intel.com>

* Changes to README and minor code improvements

Signed-off-by: Harsha Ramayanam <harsha.ramayanam@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Changes added per review

Signed-off-by: Harsha Ramayanam <harsha.ramayanam@intel.com>

---------

Signed-off-by: Harsha Ramayanam <harsha.ramayanam@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-14 17:34:39 -07:00
Hoong Tee, Yeoh
a719b61813 [rerank]: Refine documentation for rerank comps (#758)
* [rerank]: Refine documentation for rerank comps

Restructure and refine README documentation for rerank components.

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* rerank-doc: Break up README lines for viewing experience

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

---------

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
2024-10-14 15:35:33 +08:00
chen, suyue
0f1c323821 Update docformatter in pre-commit (#792)
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-10-14 14:25:34 +08:00
Sihan Chen
6da7db9ea4 Add GPT-SoVITS microservice (#784)
* add gpt-sovits microservice

* add readme

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix

* fix eol

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-12 10:44:46 +08:00
Daniel De León
5bb4046b34 Add WildGuard Guardrail Microservice (#710)
* add wildguard microservice

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* fix paths for wildguard dir

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* add README

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* add wildguard to guardrail README table

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* updates per code review

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update tokens

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* fix endpoint for testing

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* fixed formating

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* add more description of wildguard to distinguish from llamaguard

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

---------

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Letong Han <106566639+letonghan@users.noreply.github.com>
Co-authored-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
Co-authored-by: ZePan110 <ze.pan@intel.com>
2024-10-11 12:10:15 -07:00
Dan
367b3aa5db Remove unused imports across all comps (#762)
* Remove unused imports across all comps

Linting was configured to ignore unused imports.
Remove this accumulation of lint.

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* Explain why we ignore unused imports with ruff

In general unused imports should be removed, but ruff can't and probably
shouldn't automatically fix conditional imports. Consequently,
conditional imports will always be left over causing false
positive errors in CI.

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* Revert pinecone import changes

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Dan Middleton <dan.middleton@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-11 22:11:59 +08:00
ZePan110
ffe0e69ca0 Fix the issue of exiting due to inability to find hyperlinks. (#781)
Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: Hoong Tee, Yeoh <hoong.tee.yeoh@intel.com>
2024-10-11 09:28:03 +08:00
bjzhjing
84374a5710 Refactor milvus dataprep and retriever (#728)
* milvus: Refactor embedding settings for mivlus dataprep and retriever

Milvus dataprep and retriever leverage the same embedding enpoints, but
the embedding-related code is somewhat messed up, unify the namings and
logic to improve code readability and facilitate user-friendly
configuration.

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>

* MOSEC: Rename EMB_MODEL env as MOSEC_EMBEDDING_MODEL

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>

* milvus/dataprep: Update README for milvus dataprep

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>

* Add OCR package for Milvus dataprep

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>

* Update Milvus dataprep test script

This is to fix the CI issue for MILVUS environment variable name is
update.

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Cathy Zhang <cathy.zhang@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-09 23:57:19 -07:00
Chun Tao
2bbee5d316 missing dollar sign in check script for hyperlinks? (#780)
Signed-off-by: Chun Tao <chun.tao@intel.com>
2024-10-10 14:31:21 +08:00
Abolfazl Shahbazi
9e85b35b0b Remove proxy definition from within Dockerfiles (#778)
Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
2024-10-10 12:00:32 +08:00
Abolfazl Shahbazi
251907d494 Remove 'vim' from Dockerfiles (#776)
Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
2024-10-10 11:37:35 +08:00
Abolfazl Shahbazi
4f5010cfbb add 'no-cache-dir' to all pip installs (#777)
* add 'no-cache-dir' to all pip installs

Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>

* Fix a malformed line break

Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>

---------

Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
2024-10-10 11:09:47 +08:00
lvliang-intel
f3746dc85c Async support for some microservices (#763)
* Async support for some microservices

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix issues

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix issues

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix import issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add dependency library

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* roll back pinecone change

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-10 09:51:27 +08:00
ZePan110
ceba539787 Fix manual test issue (#768)
* Add debug output

Signed-off-by: ZePan110 <ze.pan@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Bug fix.

Signed-off-by: ZePan110 <ze.pan@intel.com>

* Remove comment.

Signed-off-by: ZePan110 <ze.pan@intel.com>

---------

Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-10 09:50:41 +08:00
kevinintel
028f47ac48 Update CODEOWNERS (#770) 2024-10-10 09:49:47 +08:00
chen, suyue
2ff499ea72 Add timeout for ut test (#773)
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-10-09 16:09:53 +08:00
ZePan110
78beddaa36 Optimize path and link validity check. (#745)
Signed-off-by: ZePan110 <ze.pan@intel.com>
2024-10-09 10:54:16 +08:00
ZePan110
4e5de17895 Compatible with different platforms. (#766)
* Compatible with different platforms.

Signed-off-by: ZePan110 <ze.pan@intel.com>

* Fix issue.

Signed-off-by: ZePan110 <ze.pan@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fix issue

Signed-off-by: ZePan110 <ze.pan@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: ZePan110 <ze.pan@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-08 20:57:05 +08:00
XinyuYe-Intel
5d0c436704 Add stable diffusion microservice (#729)
* add stable diffusion microservice.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* added test.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* changed output to images bytes data

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* unified inference and wrapper into one microservice.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix test.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

---------

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-08 14:13:52 +08:00
Hoong Tee, Yeoh
48b23397eb CODEOWNER: Update comp CODEOWNER (#757)
Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
2024-10-08 14:12:39 +08:00
Abolfazl Shahbazi
dfd89affe6 Misc docker updates (#761)
Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
2024-10-08 08:49:47 +08:00
David Kinder
6a1263b52b doc: fix heading level (#759)
Signed-off-by: David B. Kinder <dbkinder1@msn.com>
Co-authored-by: David B. Kinder <dbkinder1@msn.com>
2024-10-07 10:03:04 +08:00
Krishna Murti
2c0e43c318 🐛 bugfix : Retrieval on llm-vllm service not working (#756)
* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* 🐛 bugfix: Retrieval on llm-vllm service not working

Signed-off-by: Krishna Murti <krishna.murti@intel.com>

* removed LLMParamDocs instantiation

Signed-off-by: Krishna Murti <krishna.murti@intel.com>

* applied patch for recent updates for llm-vllm

Signed-off-by: Krishna Murti <krishna.murti@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Krishna Murti <krishna.murti@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-03 09:46:04 +05:30
Chendi.Xue
4638c1d45d Enable vllm for Agent (#752)
* Update Agent vllm client codes and test

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* Update README with vllm related update

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove unnecessary env

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* support plan_execute with vllm

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* Update README and test llama vllm support

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update vllm_port to 8086 avoid conflict

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

---------

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-01 10:44:14 -07:00
Hoong Tee, Yeoh
c612a7f333 [text-to-sql]: Refine and minor code refactor (#755)
* Minor code refactor

Remove unused import, unused variables and enhance docstring of code.

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

* text-to-sql: Refine documentation

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [text-to-sql]: Restructure README documentation

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-01 09:00:36 +05:30
lvliang-intel
534c227a6e Support Llama3.2 vision and vision guard model (#753)
* Support llama3.2 models

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix issues

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update code and doc

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add llama vision guard support

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add llama guard prompt format utils

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add tp support

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add wheel

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix accuracy issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update tp service code

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update dockerfile

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* support lvm tp serving

Signed-off-by: letonghan <letong.han@intel.com>

* update dockerfile

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* add run tp script

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix max_new_tokens

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update run tp script

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* refine code and doc

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* install transformers from local wheel

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* update  code using official transformers

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* remove unnecessary code

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove blank line

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix precommit issues

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* fix cd issue

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-30 17:27:41 +09:00
Dan
405a2fc68a Remove unused imports from reranks (#751)
* Remove unused imports

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* Remove unused imports

Signed-off-by: Dan Middleton <dan.middleton@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Dan Middleton <dan.middleton@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-30 09:37:15 +08:00
lvliang-intel
9df4b3c040 TEI rerank microservice async support (#746)
* tTEIrerank microservice support async

Signed-off-by: lvliang-intel <liang1.lv@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-30 09:37:00 +08:00
minmin-intel
bece9f4f03 Fix tool_render with direct import from pydantic (#750)
* fix tool renderer bug

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* clean up test script

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* switch to pydantic direct import

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-28 15:37:33 +08:00
Daniel De León
f6f620a2db Add Intel/toxic-prompt-roberta to toxicity detection microservice (#749)
* add toxic roberta model

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

* update README

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>

---------

Signed-off-by: Daniel Deleon <daniel.de.leon@intel.com>
2024-09-27 11:37:45 -07:00
chen, suyue
c4f9083c80 Fix image build (#737)
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-09-27 15:37:17 +08:00
Letong Han
71348998dc [Dataprep] Reduce Upload File Time Consumption (#744)
* reduce upload file time consumption

Signed-off-by: letonghan <letong.han@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-27 14:48:47 +08:00
ZePan110
ad8bd4f6f8 Change port for avoid port conflicts. (#747)
Signed-off-by: ZePan110 <ze.pan@intel.com>
2024-09-27 12:17:10 +08:00
Yogesh Pandey
827e3d400d Text to SQL microservice (#736)
* Initial Version of TextToSQL

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* Updated Code to add more metadata in the reply

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* Updated DockerFile

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* UpdatedREADME

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Fixed precommit CIs

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Updated yaml files

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* Updated tests to use the right directory

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* Updated tests to use the right env

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* Updates as per review comments | fixed README and requirements.txt

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Added changed as per review comments

Signed-off-by: Yogesh <yogeshpandey@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Yogesh <yogeshpandey@intel.com>
Co-authored-by: Yogesh <yogeshpandey@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-26 23:22:25 +08:00
minmin-intel
e7fdf53745 Add RAG agent and ReAct agent implemention for llama3.1 served by TGI-gaudi (#722)
* add ragagent and react agent for llama3.1

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update ut

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* debug ut

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update test and readme

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update ragagent llama docgrader

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-26 22:10:44 +08:00
dolpher
cc80c1b282 Remove unused port reference (#734)
Signed-off-by: Dolpher Du <dolpher.du@intel.com>
2024-09-26 14:59:02 +08:00
minmin-intel
c7c45d612e Update RetrievalTool Gateway to allow user setting retriever/reranker params (#730)
* first code of updated retrieval gateway to allow setting retriever/reranker params

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* send chatcompletion request to allow topk params

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* allow multiple input types

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-26 14:58:02 +08:00
Brijesh Thummar
2f08e5e47d Replaced Optional with Option. (#738)
Signed-off-by: Brijeshthummar02 <brijeshthummar02@gmail.com>
2024-09-26 14:56:04 +08:00
XinyaoWa
8a14f3727e remove old knowledgegraphs (#743)
* remove old knowledgegraphs

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

* remove knowledgegraph

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>

---------

Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
2024-09-26 14:55:45 +08:00
shaohef
e588b9fca0 change prompt usvc prot to 6018 (#740)
Signed-off-by: Shaohe Feng <shaohe.feng@intel.com>
2024-09-26 14:32:03 +08:00
lvliang-intel
286729561f Support async for embedding micorservice (#742)
* Support async in embedding micorservice

Signed-off-by: lvliang-intel <liang1.lv@intel.com>
2024-09-26 10:35:20 +08:00
Yao Qing
2159f9ad00 Fix vllm microservice performance issue. (#731)
* Fix vllm microservice performance issue.

Signed-off-by: Yao, Qing <qing.yao@intel.com>

* Refine llm generate parameters

Signed-off-by: Yao, Qing <qing.yao@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Yao, Qing <qing.yao@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-25 21:37:38 +08:00
Sihan Chen
f8f02e2e1d fix agent comps issue (#732) 2024-09-25 21:37:19 +08:00
Hoong Tee, Yeoh
9d566be203 Refine README for chat history, feedback management and prompt registry microservice (#727)
* [chat_history]: Refine README documentation

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

* [feedback_management]: Refine README documentation

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

* [prompt_registry]: Refine README documentation

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

* Fix readme typo

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-24 21:49:32 +08:00
Hoong Tee, Yeoh
1f57d070f0 faq-generation/tgi: Fix faq-generation when set streaming to false (#714)
* faq-generation/tgi: Fix faq-generation when set streaming to false

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-24 09:31:56 +08:00
Hoong Tee, Yeoh
b34903550b summarization-generation/tgi: Fix summarization generation when set streaming to false (#716)
* summarization/tgi: Fix docsum when set streaming to false

Summarization generation is not returning Internal Server error when set streaming to false to return
non-streaming response.

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

* summarization/tgi: Update README documentation

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>

---------

Signed-off-by: Yeoh, Hoong Tee <hoong.tee.yeoh@intel.com>
2024-09-23 23:01:52 +08:00
Sharan Shirodkar
4bbc7a2f55 Prediction Guard Guardrails components (#677)
* added files for PG guardrails components

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Fix pre-commit issues: end-of-file, requirements.txt, trailing whitespace, imports, and formatting

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* added package

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* file structure updated to latest

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Fix pre-commit issues: end-of-file, requirements.txt, trailing whitespace, imports, and formatting

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Add .DS_Store to .gitignore

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* updated readme,requirements+changes based on feedback

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* references classes in init.py

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* fix readme link error

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* Fix pre-commit issues: end-of-file, requirements.txt, trailing whitespace, imports, and formatting

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* removed duplicatesa

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

* removed added readme content

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>

---------

Signed-off-by: sharanshirodkar7 <ssharanshirodkar7@gmail.com>
2024-09-23 16:14:57 +08:00
XinyuYe-Intel
a03e7a559c Add image2video microservice (Stable Video Diffusion) (#465)
* added image2video microservice.

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* addition changes.

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>

* minor changes

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>

* added ut test

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* unified path.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* added gaudi support for svd.

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix bug

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix ut

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

* add docker image release file

Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>

---------

Signed-off-by: Xinyu Ye <xinyu.ye@intel.com>
Signed-off-by: Ye, Xinyu <xinyu.ye@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: chen, suyue <suyue.chen@intel.com>
Co-authored-by: lvliang-intel <liang1.lv@intel.com>
Co-authored-by: kevinintel <hanwen.chang@intel.com>
2024-09-23 14:25:56 +08:00