5 Commits

Author	SHA1	Message	Date
Johannes Gäßler	64848deb18	llama-fit-params: free memory target per device (#18679)	2026-01-08 10:07:58 +01:00
Johannes Gäßler	a52dc60ba3	llama_fit_params: return enum for fail vs. error (#18374)	2025-12-27 09:59:19 +01:00
Aadeshveer Singh	c184284230	fit-params : fix race condition in fit-params output (#18276)	2025-12-24 15:57:38 +01:00
Johannes Gäßler	4164596c76	llama-fit-params: QoL impr. for prints/errors (#18089)	2025-12-17 00:03:19 +01:00
Johannes Gäßler	b1f3a6e5db	llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653) ... * llama: automatically fit args to free memory llama-fit-params tool * fix CI * hints for bug reports, ensure no reallocation * fix segfault with Vulkan * add llama-fit-params to CI * fix CI * fix CI * fix CI * minor adjustments * fix assignment of 1 dense layer * fix logger not being reset on model load failure * remove --n-gpu-layer hint on model load failure * fix llama-fit-params verbosity * fix edge case * fix typo [no ci]	2025-12-15 09:24:59 +01:00