diff --git a/readme.md b/readme.md index c9918a2..d37a658 100644 --- a/readme.md +++ b/readme.md @@ -14,13 +14,13 @@ SCEPTER integrates popular community-driven implementations as well as proprieta SCEPTER offers 3 core components: - [Generative training and inference framework](#tutorials) - [Easy implementation of popular approaches](#currently-supported-approaches) -- [Interactive user interface: SCEPTER Studio](#launch) +- [Interactive user interface: SCEPTER Studio & Comfy UI](#launch) ## 🎉 News -- [2024.10]: We release the code of [ACE](https://arxiv.org/abs/2410.00086), supporting training / inference / gradio-based ChatBot UI. The corresponding checkpoints are uploaded on [ModelScope](https://www.modelscope.cn/models/iic/ACE-0.6B-512px) and [HuggingFace](https://huggingface.co/scepter-studio/ACE-0.6B-512px). The detailed documents can be found at [ACE repo](). +- [🔥🔥🔥2024.10]: We are pleased to announce the release of the code for [ACE](https://arxiv.org/abs/2410.00086), supporting Customized Training / Comfy UI Workflow / gradio-based ChatBot Interface. The corresponding checkpoints are uploaded on [ModelScope](https://www.modelscope.cn/models/iic/ACE-0.6B-512px) and [HuggingFace](https://huggingface.co/scepter-studio/ACE-0.6B-512px). The detailed documents can be found at [ACE repo (soon)](). - [2024.10]: Support for inference and tuning with [FLUX](https://huggingface.co/black-forest-labs/FLUX.1-dev), as well as for building [ComfyUI](https://github.com/comfyanonymous/ComfyUI) workflows using this framework. -- [🔥2024.09]: We introduce **ACE**, an **A**ll-round **C**reator and **E**ditor adept at executing a diverse array of image editing tasks tailored to your specifications. Built upon the cutting-edge Diffusion Transformer architecture, ACE has been extensively trained on a comprehensive dataset to seamlessly interpret and execute any natural language instruction. For further information, please consult the [project page](https://ali-vilab.github.io/ace-page/). +- [2024.09]: We introduce **ACE**, an **A**ll-round **C**reator and **E**ditor adept at executing a diverse array of image editing tasks tailored to your specifications. Built upon the cutting-edge Diffusion Transformer architecture, ACE has been extensively trained on a comprehensive dataset to seamlessly interpret and execute any natural language instruction. For further information, please consult the [project page](https://ali-vilab.github.io/ace-page/). - [2024.07]: Support the inference and training of open-source generative models based on the [DiT](https://arxiv.org/abs/2212.09748) architecture, such as [SD3](https://arxiv.org/pdf/2403.03206) and [PixArt](https://arxiv.org/abs/2310.00426). - [2024.05]: Introducing SCEPTER v1, supporting customized image edit tasks! Simply provide 10 image pairs, SCEPTER will tune an edit tuner for your own Image-to-Image tasks, like `Clay Style`, `De-Text`, `Segmentation`, etc. - [2024.04]: New [StyleBooth](https://ali-vilab.github.io/stylebooth-page/) demo on SCEPTER Studio for`Text-Based Style Editing`. @@ -38,7 +38,7 @@ SCEPTER offers 3 core components: ACE is a unified foundational model framework that supports a wide range of visual generation tasks. By defining CU for unifying multi-modal inputs across different tasks and incorporating long-context CU, we introduce historical contextual information into visual generation tasks, paving the way for ChatGPT-like dialog systems in visual generation. -[![Watch the demo](https://www.modelscope.cn/api/v1/models/iic/ACE-0.6B-512px/repo?Revision=master&FilePath=assets%2Ffigures%2Fteaser.png&View=true)](https://ali-vilab.github.io/ace-page/) +[![Watch the demo](https://ali-vilab.github.io/ace-page/static/images/tasks.png)](https://ali-vilab.github.io/ace-page/) #### ACE ComfyUI Workflow @@ -186,7 +186,7 @@ pip install scepter | Controllable Image Synthesis | [🌟SCEdit(CVPR24)](docs/en/tasks/scedit.md) | [![Arxiv link](https://img.shields.io/static/v1?label=arXiv&message=SCEdit&color=red&logo=arxiv)](https://arxiv.org/abs/2312.11392) [![Page link](https://img.shields.io/badge/Page-SCEdit-Gree)](https://scedit.github.io/) | | Image Editing | [🌟LAR-Gen](docs/en/tasks/largen.md) | [![Arxiv link](https://img.shields.io/static/v1?label=arXiv&message=LARGen&color=red&logo=arxiv)](https://arxiv.org/abs/2403.19534) [![Page link](https://img.shields.io/badge/Page-LARGen-Gree)](https://ali-vilab.github.io/largen-page/) | | Image Editing | [🌟StyleBooth](docs/en/tasks/stylebooth.md) | [![Arxiv link](https://img.shields.io/static/v1?label=arXiv&message=StyleBooth&color=red&logo=arxiv)](https://arxiv.org/abs/2404.12154) [![Page link](https://img.shields.io/badge/Page-StyleBooth-Gree)](https://ali-vilab.github.io/stylebooth-page/) | -| Image Generation and Editing | [🌟ACE](https://ali-vilab.github.io/ace-page/) | [![Arxiv link](https://img.shields.io/static/v1?label=arXiv&message=ACE&color=red&logo=arxiv)](https://arxiv.org/abs/2410.00086) [![Page link](https://img.shields.io/badge/Page-ACE-Gree)](https://ali-vilab.github.io/ace-page/) | +| Image Generation and Editing | [🌟ACE](https://ali-vilab.github.io/ace-page/) | [![Arxiv link](https://img.shields.io/static/v1?label=arXiv&message=ACE&color=red&logo=arxiv)](https://arxiv.org/abs/2410.00086) [![Page link](https://img.shields.io/badge/Page-ACE-Gree)](https://ali-vilab.github.io/ace-page/) [![Demo link](https://img.shields.io/badge/Demo-ACE-purple)]()
[![ModelScope link](https://img.shields.io/badge/ModelScope-Model-blue)](https://www.modelscope.cn/models/iic/ACE-0.6B-512px) [![HuggingFace link](https://img.shields.io/badge/%F0%9F%A4%97%20Hugging%20Face-Model-yellow)](https://huggingface.co/scepter-studio/ACE-0.6B-512px) | ## 🖥️ SCEPTER Studio @@ -233,7 +233,7 @@ cp -r path/to/scepter/workflow/ path/to/ComfyUI/custom_nodes/ComfyUI-Scepter cd path/to/ComfyUI python main.py ``` -Alternatively, we will support ComfyUI Manager shortly. +In addition, we also support installation and usage through the ComfyUI Manager. ## 🔍 Learn More diff --git a/scepter/methods/edit/dit_ace_0.6b_512.yaml b/scepter/methods/edit/dit_ace_0.6b_512.yaml index a8b55c0..3aa1951 100644 --- a/scepter/methods/edit/dit_ace_0.6b_512.yaml +++ b/scepter/methods/edit/dit_ace_0.6b_512.yaml @@ -23,11 +23,11 @@ SOLVER: # FILE_SYSTEM: - NAME: "HuggingfaceFs" - TEMP_DIR: ./cache + TEMP_DIR: ./cache/cache_data - NAME: "LocalFs" - TEMP_DIR: ./cache + TEMP_DIR: ./cache/cache_data - NAME: "ModelscopeFs" - TEMP_DIR: ./cache + TEMP_DIR: ./cache/cache_data # MODEL: diff --git a/scepter/methods/studio/chatbot/chatbot.yaml b/scepter/methods/studio/chatbot/chatbot.yaml index 1f68701..a47eaa1 100644 --- a/scepter/methods/studio/chatbot/chatbot.yaml +++ b/scepter/methods/studio/chatbot/chatbot.yaml @@ -1,11 +1,11 @@ WORK_DIR: chatbot FILE_SYSTEM: - NAME: LocalFs - TEMP_DIR: ./cache + TEMP_DIR: ./cache/cache_data - NAME: ModelscopeFs - TEMP_DIR: ./cache + TEMP_DIR: ./cache/cache_data - NAME: HuggingfaceFs - TEMP_DIR: ./cache + TEMP_DIR: ./cache/cache_data # ENABLE_I2V: False #