git/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp synced 2026-03-15 03:30:45 +01:00
Code Issues Packages Projects Releases Wiki Activity
b7739
llama.cpp/examples/idle/README.md
Georgi Gerganov c41bde6fbd
metal : add residency sets keep-alive heartbeat (#17766) 
* examples : add idle

* metal : attach residency sets to queue

* idle : add link

* idle : adjust intervals

* metal : add residency sets keep-alive heartbeat

* cont : adjust default keep-alive time
2025-12-05 19:38:54 +02:00

75 B
Raw Permalink Blame History

llama.cpp/example/idle

https://github.com/ggml-org/llama.cpp/pull/17766