Qwen3.5-0.8B Text Encoder for Anima

I wanted to see if Anima could run on Qwen3.5-0.8B instead of its stock Qwen3-0.6B text encoder, without retraining Anima itself. This is the result: Qwen3.5-0.8B-Base cut down to 20 layers, plus a small head (about 2.1M parameters) that translates its output into what Anima's LLM adapter expects.

Think of it as an alternative, not an upgrade. On held-out prompts the adapter output lands within 2.2% of the 0.6B (cosine 0.988), and on 300 held-out images the denoising loss is the same (0.13346 vs 0.13347). In a blind test where I didn't know which side was which, I picked the 0.8B in 4 of 12 pairs, the 0.6B in 6, and 2 were ties. So it behaves like the stock encoder, with a newer model and a bigger tokenizer (248k vocab vs 151k) underneath.

How to use

• Diffucore v0.2.1 or newer: put the file in models/text-encoders/ and pick it in the TE dropdown. Older versions had a broken Qwen3.5 encoder, so update first.
• ComfyUI: the built-in loader can't read this file. Install the comfyui-qwen35-anima-head node, put the file in models/text_encoders/, and use Load Qwen3.5 Anima Text Encoder in place of the stock CLIP loader. Everything else in your Anima workflow stays the same.

How it was made

Text-only distillation: the 0.6B is the teacher, both encoders go through Anima's frozen LLM adapter, and only the head learns to match the adapter output. The Qwen3.5 layers are untouched. 25,152 SFW prompts (Danbooru tags and captions), 4 epochs, batch 32, lr 1e-3, about 14 minutes on my RTX 2060 12GB.

License

The head is a Derivative of Anima and is released for non-commercial use under the CircleStone Labs Non-Commercial License v1.2. The Qwen3.5-0.8B-Base layers are Apache-2.0 (Copyright Alibaba Cloud), truncated to 20 layers with the final norm replaced by the head. The same notices are in the file's metadata.

The CircleStone Model is licensed by CircleStone Labs LLC under the CircleStone Non-Commercial License. Copyright CircleStone Labs LLC. IN NO EVENT SHALL CIRCLESTONE LABS LLC BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH USE OF THIS MODEL.

Modified by kayfahaarukku: this file is a Derivative of the CircleStone Model, not an official CircleStone release.

Credits

• Qwen team for Qwen3.5-0.8B and Qwen3-0.6B
• CircleStone Labs for Anima
• Training prompts from isek-ai/danbooru-tags-2024 (CC0) and CaptionEmporium/anime-caption-danbooru-2021-sfw-5m-hq (CC-BY-SA-4.0)
• The head layout (Linear, ExpRMSNorm, SiLU, Linear) follows lylogummy's Qwen3.5-4B Anima encoder

Let me know what you think! If you want to try it the easy way, it works out of the box in Diffucore UI.