git/ik_llama.cpp
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
main
ik_llama.cpp/docs/development
History
Kawrakow 0ceeb11721 Merge mainline llama.cpp (#3) 
* Merging mainline - WIP

* Merging mainline - WIP

AVX2 and CUDA appear to work.
CUDA performance seems slightly (~1-2%) lower as it is so often
the case with llama.cpp/ggml after some "improvements" have been made.

* Merging mainline - fix Metal

* Remove check

---------

Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
2024-07-27 07:55:01 +02:00
..
llama-star Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
debugging-tests.md Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
HOWTO-add-model.md Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00
token_generation_performance_tips.md Merge mainline llama.cpp (#3) 2024-07-27 07:55:01 +02:00