git/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp synced 2026-03-02 13:19:27 +01:00
Code Issues Packages Projects Releases Wiki Activity
cisc/cli-auto-completion
llama.cpp/examples/idle
History
Georgi Gerganov c41bde6fbd
metal : add residency sets keep-alive heartbeat (#17766) 
* examples : add idle

* metal : attach residency sets to queue

* idle : add link

* idle : adjust intervals

* metal : add residency sets keep-alive heartbeat

* cont : adjust default keep-alive time
2025-12-05 19:38:54 +02:00
..
CMakeLists.txt
idle.cpp
README.md

README.md

llama.cpp/example/idle

https://github.com/ggml-org/llama.cpp/pull/17766