Kroma [w4a8]

Kroma

Converted from https://huggingface.co/lodestones/Kroma/tree/main

All credit belongs to the original model author. License is the same as the original model.

Quantized qwen3vl text encoder: link.

w4a8 xl:

This version is optimized for 12GiB VRAM. The file size is ~9.2 GiB, ~40% layers are int8convrot. This ckpt should be able to fully load to the VRAM without offloading/swapping (Assuming your OS won't allocate more than 1GiB VRAM), and you get the maximum speed and better precision (Similar to GGUF XL suffix).

int8convrot and others:

https://huggingface.co/Stabhappy/kroma-v0.2-base-INT8-convrot

https://huggingface.co/silveroxides/Kroma-Quant