comfyui图片反推提示词

JoyCaption

ComfyUI-Janus-Pro

将模型文件放在 ComfyUI/models/Janus-Pro 文件夹中：

1. 在你的 ComfyUI 的 models 目录下创建 Janus-Pro 文件夹
2. 从 Hugging Face 下载模型：
   • Janus-Pro-1B
   • Janus-Pro-7B
3. 将模型解压到各自的文件夹中：

ComfyUI/models/Janus-Pro/Janus-Pro-1B/
ComfyUI/models/Janus-Pro/Janus-Pro-7B/

anus-Pro-7B：

https://huggingface.co/deepseek-ai/Janus-Pro-7B/resolve/main/config.json
https://huggingface.co/deepseek-ai/Janus-Pro-7B/resolve/main/preprocessor_config.json
https://huggingface.co/deepseek-ai/Janus-Pro-7B/resolve/main/processor_config.json
https://huggingface.co/deepseek-ai/Janus-Pro-7B/resolve/main/pytorch_model-00001-of-00002.bin
https://huggingface.co/deepseek-ai/Janus-Pro-7B/resolve/main/pytorch_model-00002-of-00002.bin
https://huggingface.co/deepseek-ai/Janus-Pro-7B/resolve/main/pytorch_model.bin.index.json
https://huggingface.co/deepseek-ai/Janus-Pro-7B/resolve/main/special_tokens_map.json
https://huggingface.co/deepseek-ai/Janus-Pro-7B/resolve/main/tokenizer.json
https://huggingface.co/deepseek-ai/Janus-Pro-7B/resolve/main/tokenizer_config.json

工作流：

joy_caption_two

安装

手动安装：

cd custom_nodes
git clone https://github.com/EvilBT/ComfyUI_SLK_joy_caption_two.git
cd ComfyUI_SLK_joy_caption_two
pip install -r requirements.txt

manager安装：

manager搜索“JoyCaptionAlpha Two for ComfyUI”

相关模型下载

siglip-so400m-patch14-384

下载地址：https://huggingface.co/google/siglip-so400m-patch14-384/tree/main

把里面的文件全部复制到models/clip/siglip-so400m-patch14-384

Llama3.1-8B-Instruct

支持两个版本：bnb-4bit是小显存的福音

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit下载地址：https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit/tree/main

把整个文件夹内的内容复制到models\LLM\Meta-Llama-3.1-8B-Instruct-bnb-4bit下

unsloth/Meta-Llama-3.1-8B-Instruct 下载地址：https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct/tree/main

把下载后的整个文件夹的内容复制到models\LLM\Meta-Llama-3.1-8B-Instruct下

Joy-Caption-alpha-two 模型

下载地址：https://huggingface.co/spaces/fancyfeast/joy-caption-alpha-two/tree/main

把cgrkzexw-599808文件夹的所有内容下载复制到models/Joy_caption_two下

核心节点

Joy Caption Two

Joy Caption Two Advanced

批量反推：

Florence-2

插件安装

github地址：GitHub - kijai/ComfyUI-Florence2: Inference Microsoft Florence2 VLM

cd custom_nodes
git clone https://github.com/kijai/ComfyUI-Florence2.git
cd ComfyUI-Florence2
pip install -r requirements.txt

模型下载

Florence-2-base下载地址:https://huggingface.co/microsoft/Florence-2-base/tree/main

Florence-2-base-ft下载地址：https://huggingface.co/microsoft/Florence-2-base-ft/tree/main

Florence-2-large下载地址：https://huggingface.co/microsoft/Florence-2-large/tree/main

Florence-2-large-ft下载地址：https://huggingface.co/microsoft/Florence-2-large-ft/tree/main

下载完成放到ComfyUI/models/LLM文件夹下

核心节点

Florence2 Run