本工作流较为复杂,但我仍然希望初学者可以流畅使用,所以我内置了许多说明笔记。
This workflow is relatively complex, but I still hope beginners can use it smoothly, so I have included many explanatory notes.
这是一个具有非常好的效果的,VRAM友好的(RTX3060 8GB完美运行,更低配置的机器也可以运行)的基于提示词的I2I工作流,内置多个调整开关,可以基于上传的图片生成姿势图、深度图、Canny边缘图等五种为Controlnet使用的图片,采用IPAdapter来保证生成人物的形态和着装精准,五种图片预处理模式和IPAdapter与ControlNet开关的搭配可以达成:仅参考人物姿势生成图片、参考人物和背景生成图片,高度参考人物和背景生成图片、仅参考人物着装和外貌生成图片、仅参考背景生成图片。
您可以在了解IPAdapter和ControlNet的工作方式后使用本工作流,本工作流使用了较多的第三方节点,这里不列出,所有的第三方节点和我使用的模型都可以在github和huggingface上找到。
This is a prompt-based I2I workflow with excellent output quality that is VRAM-friendly — it runs perfectly on an RTX3060 8GB, and can also run on lower-end machines. It includes multiple switches and options, and can generate five types of ControlNet guidance maps (such as pose maps, depth maps, Canny edge maps) based on the uploaded image. It uses IPAdapter to ensure accurate generation of the person’s appearance and clothing. The combination of five preprocessing modes and toggles for IPAdapter and ControlNet allows you to achieve multiple generation styles:
generate based only on the person’s pose,
reference the person and the background,
strongly reference both person and background,
reference only the person’s appearance and clothing,
or reference only the background.
1️⃣ IP-Adapter(人物外观 / 着装控制)
下载链接 / Download
https://huggingface.co/h94/IP-Adapter
放置文件夹 / Folder
ComfyUI/models/ipadapter/2️⃣ ControlNet 模型(姿势 / 深度 / 边缘)
统一下载入口 / Download (ControlNet models)
https://huggingface.co/lllyasviel/ControlNet
(在该页面中选择 pose / depth / canny 等模型)
放置文件夹 / Folder
ComfyUI/models/controlnet/3️⃣ SAM3(人物分割 / 轮廓 / 抠图)
下载链接 / Download
https://huggingface.co/1038lab/sam3
放置文件夹 / Folder
ComfyUI/models/sam/(或 sam3/,取决于你使用的节点说明)
本工作流可用于 SD1.5 或 SDXL,但请确保 IP-Adapter 与 ControlNet 模型版本与底模一致:
使用 SD1.5 时,请下载 sd15 标注的 IP-Adapter 和 ControlNet
使用 SDXL 时,请下载 sdxl 标注的 IP-Adapter 和 ControlNet
模型版本不匹配会导致生成异常或直接报错。
This workflow supports both SD1.5 and SDXL. Make sure the IP-Adapter and ControlNet model versions match your base checkpoint:
For SD1.5, use models labeled sd15
For SDXL, use models labeled sdxl
Mismatched versions may cause incorrect outputs or runtime errors.
