Ryan Dick 3f990393a1 Simplify the state management in InvokeLinear8bitLt and add unit tests. This is in preparation for wrapping it to support streaming of weights from cpu to gpu.		2024-12-24 14:32:11 +00:00
..
gguf	Add unit test to confirm that GGMLTensor sizes (bytes) are being calculated correctly.	2024-10-02 18:33:05 -04:00
test_bnb_llm_int8.py	Simplify the state management in InvokeLinear8bitLt and add unit tests. This is in preparation for wrapping it to support streaming of weights from cpu to gpu.	2024-12-24 14:32:11 +00:00