Files
smthemex-ComfyUI_SVFR/README.md
T
2025-01-12 10:16:32 +08:00

53 lines
2.0 KiB
Markdown
Raw Blame History

This file contains ambiguous Unicode characters
This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.
# ComfyUI_SVFR
[SVFR](https://github.com/wangzhiyaoo/SVFR/tree/main) is a unified framework for face video restoration that supports tasks such as BFR, Colorization, Inpainting,you can use it in ComfyUI
# 1. Installation
In the ./ComfyUI /custom_node directory, run the following:
```
git clone https://github.com/smthemex/ComfyUI_SVFR.git
```
# 2. Requirements
```
pip install -r requirements.txt
```
# 3. Models Required
* 3.1 download SVFR checkpoints from [google drive](https://drive.google.com/drive/folders/1nzy9Vk-yA_DwXm1Pm4dyE2o0r7V6_5mn) After decompression, place the model in the following file format,从谷歌云盘下载模型,解压后按以下文件格式放置模型;
```
├── Comfyui/models/SVFR/
| ├── id_linear.pth
| ├── insightface_glint360k.pth
| ├── unet.pth
| ├── yoloface_v5m.pt
```
* 3.2 [stabilityai/stable-video-diffusion-img2vid-xt
](https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt) or [stabilityai/stable-video-diffusion-img2vid-xt-1-1](https://huggingface.co/stabilityai/stable-video-diffusion-img2vid-xt-1-1) online or offline
```
if offline
├── anypath/stable-video-diffusion-img2vid-xt/
| ├── model_index.json
| ├── vae...
| ├── unet...
| ...
```
# 4 Inference mode
* "bfr,colorization,inpainting,bfr_color,bfr_color_inpaint",inpainting and bfr_color_inpaint mode need a mask(use comfyUI mask or black/white jpg)
# 5 Example
![](https://github.com/smthemex/ComfyUI_SVFR/blob/main/exampleA.png)
# 6 Citation
```
@misc{wang2025svfrunifiedframeworkgeneralized,
title={SVFR: A Unified Framework for Generalized Video Face Restoration},
author={Zhiyao Wang and Xu Chen and Chengming Xu and Junwei Zhu and Xiaobin Hu and Jiangning Zhang and Chengjie Wang and Yuqi Liu and Yiyi Zhou and Rongrong Ji},
year={2025},
eprint={2501.01235},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2501.01235},
}
```