git/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp synced 2026-03-12 10:10:43 +01:00
Code Issues Packages Projects Releases Wiki Activity

docs: remove README.md from llama-eval

Browse Source
This commit is contained in:
Georgi Gerganov 2026-01-31 16:17:43 +02:00
parent 5cc2258e82
commit a80814e97b
No known key found for this signature in database
GPG Key ID: 449E073F9DC10735
1 changed files with 0 additions and 17 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

17
examples/llama-eval/README.md
View File

@ -1,17 +0,0 @@
# llama.cpp/example/llama-eval
`llama-eval.py` is a single-script evaluation runner that sends prompt/response pairs to any OpenAI-compatible HTTP server (the default `llama-server`).
```bash
./llama-server -m model.gguf --port 8033
python examples/llama-eval/llama-eval.py --path_server http://localhost:8033 --n_prompts 100 --prompt_source arc
```
The supported tasks are:
- **GSM8K** — grade-school math
- **AIME** — competition math (integer answers)
- **MMLU** — multi-domain multiple choice
- **HellaSwag** — commonsense reasoning multiple choice
- **ARC** — grade-school science multiple choice
- **WinoGrande** — commonsense coreference multiple choice