This project addresses the issue of numerous hand defects in AI-generated portrait images by using a workflow based on FLUX/FLUX-Fill to correct hand deformities. It is effective for both real-life and anime images, including those generated by DiT/SDXL/Midjourney. It supports diffusers, gradio, ComfyUI, and more
本项目针对AI生成人像图片存在大量手部缺陷的问题，使用了一种基于FLUX/FLUX-Fill修复手部畸形的工作流，对真人图像和动漫图像均有效，包括由DiT/SDXL/Midjourney生成的图片；支持diffusers、gradio、ComfyUI等
- realistic images 真实感图片
| source | ORI | FIX | ORI | FIX | ORI | FIX |
|---|---|---|---|---|---|---|
| sdxl |  |
 |
 |
 |
 |
 |
| DiT |  |
 |
 |
 |
 |
 |
- anime images 动漫图片
| source | ORI | FIX | ORI | FIX | ORI | FIX |
|---|---|---|---|---|---|---|
| midjourney-v6.1 |  |
 |
 |
 |
 |
 |
| SFT-SDXL |  |
 |
 |
 |
 |
 |
- Hand Pose/Depth Controlnet: use structure/anatomy conditions to reinforce genreation
- ComfyUI workflow
pip3 install requirements.txt
python3 diffusers_pipeline.py \
--pretrained_model_name_or_path='black-forest-labs/FLUX.1-dev' \
--input_dir 'assets/examples' \
--output_dir 'outputs'
- "Download HandFixer to
ComfyUI/custom_nodes/and install the requirements." 下载HandFixer到ComfyUI/custom_nodes/并安装requirements
put HandFixer to ComfyUI/custom_nodes/
pip install -r requirements.txt
- Ensure that the model components have been downloaded. 确保模型组件已经下载
| Model Name | File Name | Installation Location | Download Link |
|---|---|---|---|
| VAE | ae.safetensors | ComfyUI/models/vae | Download |
| CLIP Model | clip_l.safetensors | ComfyUI/models/clip | Download |
| t5xxl_fp16.safetensors | ComfyUI/models/clip | Download | |
| Flux Fill Model | fluxl-fill-dev.safetensors | ComfyUI/models/unet | Flux Fill Release |
models will be downloaded from huggingface automatically
streamlit run app_streamlit.py
python3 app_gradio.py
- The FLUX-dev model is not a custom inpainting model and may occasionally have boundary artifacts; FLUX-Fill is a dedicated inpainting model with better boundary handling, but the performance on generation decreases