Alexis RollandandAmp
da2d8dd7c6
transformers >=5 dropped the CLIPTextModel '.text_model' submodule, so its state_dict keys no longer match checkpoints saved with 4.x (and vice versa), causing ChordLoadModel to fail with missing/unexpected text_encoder keys. Remap the checkpoint's text_encoder keys to whichever layout the built model expects before load_state_dict, so loading works on both transformers 4.x and 5.x. Amp-Thread-ID: https://ampcode.com/threads/T-019ef30e-4d7d-72ac-a888-b80e4d33c7ab Co-authored-by: Amp <amp@ampcode.com>
ComfyUI-Chord
ComfyUI custom node for the paper: Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Images
Installation
-
Download and install ComfyUI. If you are new to ComfyUI, refer to the original repository to get started. Make sure you have the latest version.
-
Download the pretrained model chord_v1.safetensors from Hugging Face and place it in the folder ./ComfyUI/models/checkpoints.
-
Install the custom nodes from the ComfyUI-Manager or by manually cloning this repository in the custom nodes folder:
# Clone the repository
cd ./ComfyUI/custom_nodes
git clone https://github.com/ubisoft/ComfyUI-Chord.git
# Install dependencies
## For Windows portable version
..\..\python_embeded\python.exe -s -m pip install -r .\ComfyUI-Chord\requirements.txt
## Or for Python version
pip install -r .\ComfyUI-Chord\requirements.txt
Example Workflow
You can load this workflow using the JSON file example_workflows/chord_image_to_material.json or by dropping the image in ComfyUI.
License
This project is released under the Ubisoft Machine Learning License (Research-Only - Copyleft). See the full terms in the LICENSE file.
Citation
If you find our work useful, please consider citing:
@inproceedings{ying2025chord,
author = {Ying, Zhi and Rong, Boxiang and Wang, Jingyu and Xu, Maoyuan},
title = {Chord: Chain of Rendering Decomposition for PBR Material Estimation from Generated Texture Images},
year = {2025},
isbn = {9798400721373},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3757377.3763848},
doi = {10.1145/3757377.3763848},
booktitle = {Proceedings of the SIGGRAPH Asia 2025 Conference Papers},
articleno = {164},
numpages = {11},
keywords = {Appearance Modeling, Material Generation, Texture Synthesis, SVBRDF, Image-conditional Diffusion Models},
series = {SA Conference Papers '25}
}
© [2025] Ubisoft Entertainment. All Rights Reserved.