Commit Graph

19 Commits

Author SHA1 Message Date
lkk
3ce77ad896 Refactor agent create assistant api (#1142)
- instantiate agent when request http://${ip_address}:9091/v1/assistants
- allow user to config agent through api call

#982
2025-01-16 22:51:37 +08:00
lkk
3a7ccb0a75 add tool choices for agent. (#1126) 2025-01-13 14:42:31 +08:00
lkk
cf90932fef refine agent directories. (#1109) 2025-01-06 17:35:39 +08:00
XinyaoWa
679e6664d4 Rename streaming to stream to align with OpenAI API (#1098)
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
2025-01-06 13:25:47 +08:00
minmin-intel
717c3c1025 Add SQL agent strategy (#1039)
* initial code for sql agent llama

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* add test for sql agent

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update sql agent test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* fix bugs and use vllm to test sql agent

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* add tag-bench test and google search tool

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* test sql agent with hints

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* fix bugs for sql agent with hints and update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add readme for sql agent and fix ci bugs

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add sql agent using openai models

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix bugs in sql agent openai

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* make wait time longer for sql agent microservice to be ready

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update readme

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* fix test bug

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* skip planexec with vllm due to vllm-gaudi bug

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* debug ut issue

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* use vllm for all uts

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* debug ci issue

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* change vllm port

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update ut

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* remove tgi server

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* align vllm port

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* remove unnecessary files and fix bugs

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* connect to db with full uri

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update readme and use vllm mainstream

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* rm unnecessary log

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update readme

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update test script

Signed-off-by: minmin-intel <minmin.hou@intel.com>

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-12-18 21:35:58 +08:00
minmin-intel
46835f95da Revert "Add SQL agent strategy (#975)" (#1030)
This reverts commit c36c5032dc.

Co-authored-by: lkk <33276950+lkk12014402@users.noreply.github.com>
2024-12-14 12:09:14 +08:00
minmin-intel
c36c5032dc Add SQL agent strategy (#975)
* initial code for sql agent llama

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* add test for sql agent

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update sql agent test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* fix bugs and use vllm to test sql agent

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* add tag-bench test and google search tool

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* test sql agent with hints

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* fix bugs for sql agent with hints and update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add readme for sql agent and fix ci bugs

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add sql agent using openai models

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix bugs in sql agent openai

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* make wait time longer for sql agent microservice to be ready

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update readme

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* fix test bug

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* skip planexec with vllm due to vllm-gaudi bug

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* debug ut issue

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* use vllm for all uts

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* debug ci issue

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* change vllm port

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update ut

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* remove tgi server

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* align vllm port

Signed-off-by: minmin-intel <minmin.hou@intel.com>

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-12-11 10:55:55 -08:00
ZePan110
f19cf083d1 Rename image names XXX-hpu to XXX-gaudi (#911)
Signed-off-by: ZePan110 <ze.pan@intel.com>
2024-11-19 22:06:55 +08:00
ZePan110
0dbf57751b Standardize the naming format of images (#898)
Signed-off-by: ZePan110 <ze.pan@intel.com>
2024-11-14 18:22:27 +08:00
lkk
e39b08f3d0 agent short & long term memory with langgraph. (#851)
* draft a demo code for memory.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add agent short-term memory with langgraph checkpoint.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add save long-term memory func.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* add save long-term memory func.

* add timeout for llm response.

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix ut with adding -e HABANA_VISIBLE_DEVICES=all.

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-11-12 17:28:37 +08:00
minmin-intel
c8e363901a Update RAGAgentLlama and ReActLlama (#843)
* use ChatOpenAI to interface with TGI-gaudi

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update tools for unit test

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update readme and test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* fix test script

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* consolidate chat model setup

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update tests and readme

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* revert react llama output parser

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-11-01 15:40:14 -07:00
Chendi.Xue
3473bfb38b [Agent] support custom prompt (#798)
* habana_main issue fixed, now use original dockerfile

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* Enable custom_prompt

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* Update README

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

---------

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-22 19:26:32 +08:00
Abolfazl Shahbazi
9e85b35b0b Remove proxy definition from within Dockerfiles (#778)
Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
2024-10-10 12:00:32 +08:00
Abolfazl Shahbazi
4f5010cfbb add 'no-cache-dir' to all pip installs (#777)
* add 'no-cache-dir' to all pip installs

Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>

* Fix a malformed line break

Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>

---------

Signed-off-by: Abolfazl Shahbazi <abolfazl.shahbazi@intel.com>
2024-10-10 11:09:47 +08:00
Chendi.Xue
4638c1d45d Enable vllm for Agent (#752)
* Update Agent vllm client codes and test

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* Update README with vllm related update

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* remove unnecessary env

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* support plan_execute with vllm

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* Update README and test llama vllm support

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update vllm_port to 8086 avoid conflict

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

---------

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-01 10:44:14 -07:00
minmin-intel
bece9f4f03 Fix tool_render with direct import from pydantic (#750)
* fix tool renderer bug

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* clean up test script

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* switch to pydantic direct import

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-28 15:37:33 +08:00
minmin-intel
e7fdf53745 Add RAG agent and ReAct agent implemention for llama3.1 served by TGI-gaudi (#722)
* add ragagent and react agent for llama3.1

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update ut

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* debug ut

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update test

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

* update test and readme

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* update ragagent llama docgrader

Signed-off-by: minmin-intel <minmin.hou@intel.com>

* [pre-commit.ci] auto fixes from pre-commit.com hooks

for more information, see https://pre-commit.ci

---------

Signed-off-by: minmin-intel <minmin.hou@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-26 22:10:44 +08:00
chen, suyue
3d00a33e09 update image build compose (#698)
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-09-18 11:11:59 +08:00
Letong Han
bea9bb0242 [Reorg] Reorg Folder to Support Different Vendors (#625)
Signed-off-by: letonghan <letong.han@intel.com>
Signed-off-by: chensuyue <suyue.chen@intel.com>
2024-09-10 23:24:09 +08:00