diff --git a/README.md b/README.md index bd7f1e5..8202d53 100644 --- a/README.md +++ b/README.md @@ -43,22 +43,134 @@ ## 🔥 ACE Models ACE++ provides a comprehensive toolkit for image editing and generation to support various applications. We encourage developers to choose the appropriate model based on their own scenarios and to fine-tune their models using data from their specific scenarios to achieve more stable results. -| **Model** | *Tuning Method* | **Description** | **Examples** | **Model Path(scepter_path)** | -|:------------------:|:------------------------:|:--------------------------------------------------------------------------------------------------------------------------------------------------------:|:----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| -| ACE++ Portrait | LoRA + ACE Data | Portrait-consistent generation to
maintain the consistency of the portrait . | Image 1 Image 2

Maintain the facial features, A girl is wearing a neat police uniform and sporting a badge.
She is smiling with a friendly and confident demeanor. The background is blurred, featuring a cartoon logo.

| [![ModelScope link](https://img.shields.io/badge/ModelScope-Model-blue)](https://www.modelscope.cn/models/iic/ACE_Plus/)
ms://iic/ACE_Plus@portrait/xxxx.safetensors]
[![HuggingFace link](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-yellow)](https://huggingface.co/ali-vilab/ACE_Plus/tree/main/portrait/)
hf://ali-vilab/ACE_Plus@portrait/xxxx.safetensors | -| ACE++ Subject | LoRA + ACE Data | Subject-driven image generation
task to maintain the consistency of
a specific subject in different scenes. | Image 1 Image 2

Display the logo in a minimalist style printed in white on a matte black ceramic coffee mug, alongside a steaming cup of coffee on a cozy cafe table.

| [![ModelScope link](https://img.shields.io/badge/ModelScope-Model-blue)](https://www.modelscope.cn/models/iic/ACE_Plus/)
ms://iic/ACE_Plus@subject/xxxx.safetensors]
[![HuggingFace link](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-yellow)](https://huggingface.co/ali-vilab/ACE_Plus/tree/main/subject/)
hf://ali-vilab/ACE_Plus@subject/xxxx.safetensors | -| ACE++ LocalEditing | LoRA + ACE Data | Redrawing the mask area of images
while maintaining the original structural
information of the edited area. | Image 1 Image 1 Image 2

By referencing the mask, restore a partial image from the doodle {image} that aligns with the textual explanation: "1 white old owl".

| [![ModelScope link](https://img.shields.io/badge/ModelScope-Model-blue)](https://www.modelscope.cn/models/iic/ACE_Plus/)
ms://iic/ACE_Plus@local_editing/xxxx.safetensors]
[![HuggingFace link](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-yellow)](https://huggingface.co/ali-vilab/ACE_Plus/tree/main/local_editing/)
hf://ali-vilab/ACE_Plus@local_editing/xxxx.safetensors | -| ACE++ | Full Finetune + ACE Data |Fully finetuning a composite model with ACE’s
data to support various editing and reference
generation tasks through an instructive approach. | | Will be released soon. | + + + +### ACE++ Portrait +Portrait-consistent generation to maintain the consistency of the portrait. + + + + + + + + + + + + + + + + + +
Tuning MethodInputOutputInstructionModels
LoRA
+ ACE Data
"Maintain the facial features. A girl is wearing a neat police uniform and sporting a badge. She is smiling with a friendly and confident demeanor. The background is blurred, featuring a cartoon logo."ModelScope link HuggingFace link
+ +Models' scepter_path: +- **ModelScope:** ms://iic/ACE_Plus@portrait/xxxx.safetensors +- **HuggingFace:** hf://ali-vilab/ACE_Plus@portrait/xxxx.safetensors + + +### ACE++ Subject +Subject-driven image generation task to maintain the consistency of a specific subject in different scenes. + + + + + + + + + + + + + + + + +
Tuning MethodInputOutputInstructionModels
LoRA
+ ACE Data
"Display the logo in a minimalist style printed in white on a matte black ceramic coffee mug, alongside a steaming cup of coffee on a cozy cafe table."ModelScope link HuggingFace link
+ +Models' scepter_path: +- **ModelScope:** ms://iic/ACE_Plus@subject/xxxx.safetensors +- **HuggingFace:** hf://ali-vilab/ACE_Plus@subject/xxxx.safetensors + + +### ACE++ LocalEditing +Redrawing the mask area of images while maintaining the original structural information of the edited area. + + + + + + + + + + + + + + + + +
Tuning MethodInputOutputInstructionModels
LoRA
+ ACE Data

"By referencing the mask, restore a partial image from the doodle {image} that aligns with the textual explanation: "1 white old owl"."ModelScope link HuggingFace link
+ +Models' scepter_path: +- **ModelScope:** ms://iic/ACE_Plus@local_editing/xxxx.safetensors +- **HuggingFace:** hf://ali-vilab/ACE_Plus@local_editing/xxxx.safetensors + +### ACE++ Fully [Coming soon] +Fully finetuning a composite model with ACE’s data to support various editing and reference generation tasks through an instructive approach. ## 🔥 Applications The ACE++ model supports a wide range of downstream tasks through simple adaptations. Here are some examples, and we look forward to seeing the community explore even more exciting applications utilizing the ACE++ model. -| Application | ACE++ Model | Examples | -|:-------------------:|:--------------:|:-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------:| -| Try On | ACE++ Subject | Image 1Image 1Image 1 Image 2

The woman dresses this skirt.

| -| Logo Paste | ACE++ Subject | Image 1Image 1Image 1 Image 2

The logo is printed on the headphones.

| -| Photo Editing | ACE++ Subject | Image 1Image 1Image 1 Image 2

The item is put on the ground.

| -| Movie Poster Editor | ACE++ Portrait | Image 1Image 1Image 1 Image 2

The man is facing the camera and is smiling.

| + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +
ApplicationACE++ ModelExamples
Try OnACE++ Subject"The woman dresses this skirt."
Logo PasteACE++ Subject"The logo is printed on the headphones."
Photo EditingACE++ Subject"The item is put on the ground."
Movie Poster EditorACE++ Portrait"The man is facing the camera and is smiling."
## ⚙️️ Installation Download the code using the following command: @@ -132,4 +244,4 @@ If you use this model in your research, please cite the works of FLUX.1-dev and journal={arXiv preprint arXiv:2410.00086}, year={2024} } -``` \ No newline at end of file +```