Yue2 TEXT or REFERENCE to Song/Cover with Ollama

The Workflow was setup to have a clean "GUI" showing only parameters that matter, so you might want to toggle off Link visibility, like in above screenshot.

Features of this workflow:

- Standard song creation (Text to Song) or Cover song creation with input song as reference (reference to cover-song)

- Tags creation with Ollama or Style Presets or own tags

- Lyrics generation with either:

• Ollama

• Re-writer (rewrites Lyrics to match the singing structure of the input lyrics)

• Song Analyzer (analyses Input Song and extracts Lyrics as text)

• Own lyrics

- creates matching Song/filename with Ollama

download files:

https://huggingface.co/Comfy-Org/YuE2/tree/main

recommended Ollama models for Tags/Lyrics/Songname/Re-write:

https://ollama.com/4skl/gemma4-e4b-mtp

for Tags with references to existing artist/bands/songs and for Re-write lyrics:

https://ollama.com/kwmcglon/gemma4-31b-abliterated

Save Location:

📂 ComfyUI/

└── 📂 models/

├── 📂 audio_encoders/

│ └── sheetsage2_bf16.safetensors

└── 📂 checkpoints/

└── yue2_3b_bf16.safetensors

Custom nodes used:

• https://github.com/rgthree/rgthree-comfy

• https://github.com/yolain/ComfyUI-Easy-Use

• https://github.com/stavsap/comfyui-ollama

• https://github.com/TheLocalLab/ComfyUI-SongScribe

• https://github.com/Kosinkadink/ComfyUI-VideoHelperSuite

Ollama help:

1. Install Ollama from https://ollama.com/

2. download a model: Go to a model page, chose a model , then hit the copy button, i.e. https://ollama.com/mirage335/Llama-3-NeuralDaredevil-8B-abliterated-virtuoso

3. open terminal and paste the model name, i.e.: ollama run huihui_ai/qwen3-vl-abliterated

4. model will be downloaded and can be selected in green comfy node "Ollama Connectivity". Hit "Reconnect" to refresh.