Download
1 variant available
int4 SafeTensor
anima-turbo-v1.1-w4a4-mse.safetensors
4-bit integer, smallest • 1.44 GB
Verified: 14 hours ago
License:
AnimaThe Anima Model is licensed by CircleStone Labs LLC. Copyright CircleStone Labs LLC. IN NO EVENT SHALL CIRCLESTONE LABS LLC BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.
Built on NVIDIA Cosmos
Anima INT4 quantization, size is 1.437 GB, about 63% smaller than BF16.
Simple convrot_w4a4 seems to cause a massive quality loss so this is an attempt to restore some of it while retaining the storage advantage of INT4.
The improvement is primarily from using MSE (Mean Squared Error) method when selecting scale rather than the default maximum, it allows to find a scale that minimizes quantization error as much as possible. Tests show about 43% lower weight reconstruction error related to just convrot_w4a4.
Comparison images are at the end so you can see how the model fares compared to int8_convrot and convrot_w4a4.