llama.cpp/docs/backend
Zijun Yu 52f1096f21
openvino: driver setup, CI split, thread safety, and NPU optimizations (#21944)
* Thread safety per request only

* Fix ROPE yarn case

* Fix sticky stateful config

* Use i4/i8 directly for symmetric quant

* Use weightless caching

* Add WeightlessCacheAttribute to reduce NPU memory usage

* Gelu tanh support (#125)

* Imrope support (#126)

* fix(openvino): explicit ov::Tensor frees in ggml_backend_openvino_free

* add GPU,NPU support in OV Dockerfile

* add build-openvino.yml ci

* Fix sticky stateful config

* add concurrency to ov-gpu ci runs. Move OV CI to build-openvino.yml

* fix thread-safety of shared runtime context

* rope type abstraction for frontend translations

* fix editorconfig

---------

Co-authored-by: Mustafa Cavus <mustafa.cavus@intel.com>
Co-authored-by: Dan Hoffman <dhoff749@gmail.com>
Co-authored-by: Ravi Panchumarthy <ravi.panchumarthy@intel.com>
2026-04-21 18:58:34 +03:00
..
snapdragon hexagon: add support for linux on snapdragon (#21707) 2026-04-10 15:57:23 -07:00
VirtGPU ggml-virtgpu: Fix some build commands (#20341) 2026-03-12 15:47:45 +08:00
BLIS.md make : deprecate (#10514) 2024-12-02 21:22:53 +02:00
CANN.md CANN: update docker images to 8.5.0 and improve CANN.md (#20801) 2026-03-27 08:53:00 +08:00
CUDA-FEDORA.md docs: update: improve the Fedoa CUDA guide (#12536) 2025-03-24 11:02:26 +00:00
OPENCL.md docs: add linux to index (#18907) 2026-01-18 18:03:35 +08:00
OPENVINO.md openvino: driver setup, CI split, thread safety, and NPU optimizations (#21944) 2026-04-21 18:58:34 +03:00
SYCL.md [SYCL] Fix Q8_0 reorder: garbage on 2nd prompt + crash on full VRAM (#21638) 2026-04-16 08:34:05 +03:00
VirtGPU.md ggml-virtgpu: improve the reliability of the code (#19846) 2026-02-26 20:00:57 +08:00
zDNN.md ggml-zendnn : add ZenDNN backend for AMD CPUs (#17690) 2025-12-07 00:13:33 +08:00
ZenDNN.md ggml-zendnn : add MUL_MAT_ID op support for MoE models (#21315) 2026-04-03 12:19:08 +03:00