Qwen for MinimaxH3 (QP)
NOTE: If you downloaded the day one version I had quantized the wrong files resulting in a lobotimized LLM
Requirements:
Update CUDA to 13.4.2
Update Pytorch to 13.2
Update at minimum comfy-aimdo, comfy-kitchen
Basic workflow shows how to use both first frame text guided and first frame last frame with comfy kitchen backend node to speed up generation by 60% (This prevents pyattention fallback which is slow)
pytorch version: 2.13.0+cu132
xformers version: 0.0.35
Using xformers attention
ComfyUI version: 0.35.0
comfy-aimdo version: 0.5.5
comfy-kitchen version: 0.2.34
Consider --disable-dynamic-vram if you are having OOM issues after a few generation or crash when trying to use comfy kitchen vs pyattention
QP (Quantization Prediction)
QP is theoretically improving 40-50% of the blocks on the trailing 16 Matnitsa bits.
For the other 50-60% that it does not improve it did not degrade them more then what they would have been rounded to in the first place.
This was tested on Full FP32 trainings such as T5.
