Duplicate from vuongminhkhoi4/ComfyUI_InfiniteYou

Co-authored-by: Vuong <[email protected]>

.gitattributes

@@ -0,0 +1,39 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+face_combine_workflow.png filter=lfs diff=lfs merge=lfs -text
+musk.png filter=lfs diff=lfs merge=lfs -text
+teaser.jpg filter=lfs diff=lfs merge=lfs -text
+workflow_example.png filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,130 @@
+---
+license: apache-2.0
+---
+
+
+# 🚀 ComfyUI_InfiniteYou
+An implementation of **InfiniteYou** for **ComfyUI**
+
+Native support for [InfiniteYou](https://github.com/bytedance/InfiniteYou) in [ComfyUI](https://github.com/comfyanonymous/ComfyUI), designed by the ZenAI team.  
+
+
+**✨ Support further development by starring the project! ✨**
+
+
+![teaser](./teaser.jpg)
+
+---
+
+## 🔥 News
+- **[03/2025]** 🔥 Integrate Face Combine feature to predict future children
+- **[03/2025]** 🔥 Code updated and released as the first version.
+
+---
+
+## 📜 Introduction  
+
+🚀 **InfiniteYou** is a **SOTA zero-shot identity preservation** model by **ByteDance**, built on **FLUX**. This repo brings it to **ComfyUI**, powered by **ZenAI**.  
+
+🔗 **References:**  
+📄 [Paper](https://arxiv.org/abs/2503.16418) | 💾 [Official Repo](https://github.com/bytedance/InfiniteYou)  
+
+💡 Inspired by **ZenID** 🔗 [ZenID Repo](https://github.com/vuongminh1907/ComfyUI_ZenID)  
+
+🔥 Stay tuned for updates!  
+
+---
+
+## 🏆 Model Zoo
+
+The main author has released two versions of the model, each tailored for a specific purpose:  
+
+- 🔹 **sim_stage1** – Prioritizes **higher identity similarity** for more accurate face preservation.  
+- 🎨 **aes_stage2** – Focuses on **better text-image alignment** and enhanced **aesthetics**.  
+
+To ensure seamless integration with **ComfyUI**, we have converted the model to the **safetensors** format. 
+
+
+**Download the model on Hugging Face:**  
+👉 [ComfyUI_InfiniteYou](https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou) 
+---
+
+## 🛠️ Workflow
+### **Zero-Shot Task**
+![Musk](./musk.png)
+
+### **FaceCombine Task**
+![Children](./face_combine_workflow.png)
+---
+
+## 📦 Installation
+
+### Step 1: Clone the Repo
+```bash
+cd custom_nodes
+git clone https://github.com/ZenAI-Comfy/ComfyUI_InfiniteYou
+```
+### Step 2: Install Requirements
+```bash
+cd ComfyUI_InfiniteYou
+pip install -r requirements.txt
+```
+
+### Step 3: Download ControlNet Models
+```bash
+cd ../../models/controlnet
+wget https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/aes_stage2_control_net/aes_stage2_control.safetensors
+wget https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/sim_stage1_control_net/sim_stage1_control_net.safetensors
+cd ..
+```
+### Step 4: Download Image Projection Files
+```bash
+mkdir InfiniteYou
+cd InfiniteYou
+wget https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/aes_stage2_control_net/aes_stage2_img_proj.bin
+wget https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/resolve/main/sim_stage1_control_net/sim_stage1_img_proj.bin
+cd ../..
+```
+### Step 5: Download InsightFace model
+The InsightFace model is **antelopev2** (not the classic buffalo_l). Download the models (for example from [here](https://drive.google.com/file/d/18wEUfMNohBJ4K3Ly5wpTejPfDzp-8fI8/view?usp=sharing) or [here](https://huggingface.co/MonsterMMORPG/tools/tree/main)), unzip and place them in the `ComfyUI/models/insightface/models/antelopev2` directory.
+
+Alternatively, you can quickly download all **models** using the following command:
+```
+# make sure you are in the ComfyUI directory
+cd custom_nodes/
+git clone https://github.com/ZenAI-Vietnam/ComfyUI_InfiniteYou
+python ComfyUI_InfiniteYou/downloadmodel.py
+pip install -r ComfyUI_InfiniteYou/requirements.txt
+```
+
+## 🧭 Usage
+
+🔹 For `aes_stage2`: Try file `aes_stages2.json` in `workflows`
+
+🔹 For `sim_stage1`: Try file `sim_stages1.json` in `workflows`
+
+Predict your future children
+🔹 For `Face Combine`: Try file `face_combine.json` in `workflows`
+
+
+
+## 📞 Contact for Work 🌟
+This implementation of InfiniteYou is brought to you by the ZenAI Team.
+
+<img src="https://huggingface.co/vuongminhkhoi4/ComfyUI_InfiniteYou/blob/main/zenai.png" width="400" />
+
+If you need more polished and enhanced version, please contact us through:  
+- 📱 **Facebook Page**: [ZenAI](https://web.facebook.com/zenai.vn)  
+- ☎️ **Phone**: 0971912713 Miss. Chi 
+
+## 📖 Citation
+
+```bibtex
+@article{jiang2025infiniteyou,
+  title={{InfiniteYou}: Flexible Photo Recrafting While Preserving Your Identity},
+  author={Jiang, Liming and Yan, Qing and Jia, Yumin and Liu, Zichuan and Kang, Hao and Lu, Xin},
+  journal={arXiv preprint},
+  volume={arXiv:2503.16418},
+  year={2025}
+}
+```

aes_stage2_control_net/aes_stage2_control.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62ec6e658775747ae2eea8abec8af30eb92b74a57ce0a7087693d3381626e727
+size 5905345320

aes_stage2_control_net/aes_stage2_img_proj.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f85518431d7367de30b9558a939c003462a7e331e8c8b929146916dc27e471d6
+size 338413026

aes_stage2_control_net/config.json

@@ -0,0 +1,21 @@
+{
+  "_class_name": "FluxControlNetModel",
+  "_diffusers_version": "0.31.0",
+  "_infu_flux_version": "1.0",
+  "attention_head_dim": 128,
+  "axes_dims_rope": [
+    16,
+    56,
+    56
+  ],
+  "conditioning_embedding_channels": null,
+  "guidance_embeds": true,
+  "in_channels": 64,
+  "joint_attention_dim": 4096,
+  "num_attention_heads": 24,
+  "num_layers": 4,
+  "num_mode": null,
+  "num_single_layers": 10,
+  "patch_size": 1,
+  "pooled_projection_dim": 768
+}

sim_stage1_control_net/config.json

@@ -0,0 +1,21 @@
+{
+  "_class_name": "FluxControlNetModel",
+  "_diffusers_version": "0.31.0",
+  "_infu_flux_version": "1.0",
+  "attention_head_dim": 128,
+  "axes_dims_rope": [
+    16,
+    56,
+    56
+  ],
+  "conditioning_embedding_channels": null,
+  "guidance_embeds": true,
+  "in_channels": 64,
+  "joint_attention_dim": 4096,
+  "num_attention_heads": 24,
+  "num_layers": 4,
+  "num_mode": null,
+  "num_single_layers": 10,
+  "patch_size": 1,
+  "pooled_projection_dim": 768
+}

sim_stage1_control_net/sim_stage1_control_net.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8ee8efc6d6e4eb746ea4634318a09c96f4b7c61318d04e644a5351f6e26b5fb5
+size 5905345320

sim_stage1_control_net/sim_stage1_img_proj.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b7a8a1b6fecf2731b2ac64bde33a1885014949c8c08f3efaebd0665bb0e8ad8f
+size 338413026