jandres/GenAIExamples
1
0
Fork 0
Code Issues Pull Requests Actions 4 Packages Projects Releases Wiki Activity

Update benchmark scripts (#1883)

Browse Source 
Signed-off-by: chensuyue <suyue.chen@intel.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
(cherry picked from commit be5933ad85)
This commit is contained in:
chen, suyue
2025-04-25 17:05:48 +08:00
committed by chensuyue
parent c956de0f51
commit 63277feabb
6 changed files with 21 additions and 20 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
deploy_and_benchmark.py
View File

@@ -54,7 +54,7 @@ def construct_deploy_config(deploy_config, target_node, batch_param_value=None,
# First determine which llm replicaCount to use based on teirerank.enabled
services = new_config.get("services", {})
teirerank_enabled = services.get("teirerank", {}).get("enabled", True)
teirerank_enabled = services.get("teirerank", {}).get("enabled", False)
# Process each service's configuration
for service_name, service_config in services.items():