Ryan Dick a8b2c4c3d2 Add inference tests for all custom module types (i.e. to test autocasting from cpu to device).		2024-12-26 18:33:46 +00:00
..
gguf	Add inference tests for all custom module types (i.e. to test autocasting from cpu to device).	2024-12-26 18:33:46 +00:00
scripts	Rename params for flux and flux vae, add comments explaining use of the config_path in model config	2024-08-26 20:17:50 -04:00
__init__.py	Move requantize.py to the quatnization/ dir.	2024-08-26 20:17:50 -04:00
bnb_llm_int8.py	Simplify the state management in InvokeLinear8bitLt and add unit tests. This is in preparation for wrapping it to support streaming of weights from cpu to gpu.	2024-12-24 14:32:11 +00:00
bnb_nf4.py	Install sub directories with folders correctly, ensure consistent dtype of tensors in flux pipeline and vae	2024-08-26 20:17:50 -04:00