Jeff Bolz
e02fb860cc
Rewrite simple-backend to use sched and ggml_backend_load_all ( #1376 )
...
* Rewrite simple-backend to use sched and ggml_backend_load_all
* address slaren's feedback
* move the storage to the model class
2025-10-29 18:10:19 +01:00
AN Long
f1b539d6ae
simple : fix typo ( #1319 )
2025-08-02 17:28:28 +03:00
Shawn yang
d633684e9b
fix a bug in examples/simple/simple-backend ( #1078 )
...
Co-authored-by: yangxiao <yang_xl@tju.edu.cn>
2025-02-07 11:10:21 -06:00
slaren
f3c1e6aeaa
update tests and examples
2024-11-04 19:42:09 +02:00
Georgi Gerganov
c73d836bbf
examples : adapt to new ggml backend interfaces
...
ggml-ci
2024-10-03 22:12:49 +03:00
Georgi Gerganov
6b30c17879
metal : add perf-metal tool + fix build
2024-10-01 18:08:31 +03:00
Georgi Gerganov
336c10a4c3
examples : adapt to ggml.h changes ( #0 )
...
ggml-ci
2024-09-20 22:03:57 +03:00
Georgi Gerganov
5378ea0d3c
ggml : reorganize source code + improve CMake ( #865 )
...
* scripts : update sync [no ci]
* ggml : move headers one up [no ci]
* files : reorganize + update CMake
ggml-ci
* cmake : build normal ggml library
ggml-ci
* cmake : link math library to test + remove ci for code cov
ggml-ci
* files : move public headers to include
ggml-ci
2024-06-26 19:33:53 +03:00
Georgi Gerganov
39060c7b41
examples : more CUDA leftovers ( #0 )
2024-03-27 13:20:00 +02:00
leejet
274680868e
add some new ops, fix some operators and add batch operations to certain operators. ( #747 )
...
* cuda: fix group_norm
* cuda: add batch inference support for ggml_pad/ggml_upscale
* add ggml_arrange
* add ggml_timestep_embedding
* update ggml_arange/ggml_timestep_embedding tests
* cuda: fix im2col
* add ggml_arange/ggml_timestep_embbeding support for metal backend
* fix some bugs
* fix some bugs
* Update include/ggml/ggml.h
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* Update src/ggml-cuda.cu
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* Update src/ggml-metal.m
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* Update src/ggml-metal.m
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* Update src/ggml-metal.metal
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
* modify according to the review comments
* ggml : fix compile warnings + code style
* ggml : normalize compute_forward calls + fix seg fault in debug
* minor
---------
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: slaren <slarengh@gmail.com>
2024-03-03 13:23:52 +01:00
Steward Garcia
d9cd6b5709
ggml : add simple example ( #713 )
...
* add simple example for explain memory management and basic operation of ggml
2024-02-28 11:40:12 -05:00
