Files
GenAIExamples/CodeGen/benchmark/accuracy/run_acc.sh
lkk 088ab98f31 update examples accuracy (#941)
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
2024-10-14 13:20:50 +08:00

14 lines
274 B
Bash

# Copyright (C) 2024 Intel Corporation
# SPDX-License-Identifier: Apache-2.0
python main.py --model $1 \
--tasks humaneval \
--codegen_url $2 \
--max_length_generation 2048 \
--batch_size 1 \
--save_generations \
--save_references \
--allow_code_execution