Update README.md
This commit is contained in:
heiume
@@ -6,53 +6,22 @@ A custom nodes module for **creating real-time interactive avatars** powered by
|
||||
|
||||
# Demo
|
||||
|
||||
| Demo Name | Demo Name | Demo Name | Demo Name |
|
||||
| ------------- | ------------- | ------------- | ------------- |
|
||||
| <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/47fd5a98-ab0f-4c5c-b132-5d4b0aa02763.mp4"> | <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/b229a4b3-88ba-4755-a8e0-9149260eef12.mp4"> | <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/e054e1a9-eb20-4ca6-be44-0ba9c7c07d50"> | <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/47fd5a98-ab0f-4c5c-b132-5d4b0aa02763.mp4"> |
|
||||
| <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/47fd5a98-ab0f-4c5c-b132-5d4b0aa02763.mp4"> | <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/b229a4b3-88ba-4755-a8e0-9149260eef12.mp4"> | <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/e054e1a9-eb20-4ca6-be44-0ba9c7c07d50"> | <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/47fd5a98-ab0f-4c5c-b132-5d4b0aa02763.mp4"> |
|
||||
| --- | --- | --- | --- |
|
||||
| [➡️Open in Avatech Labs]() | [➡️Open in Avatech Labs]() | [➡️Open in Avatech Labs]() | [➡️Open in Avatech Labs]() |
|
||||
|
||||
| <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/47fd5a98-ab0f-4c5c-b132-5d4b0aa02763.mp4"> | <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/b229a4b3-88ba-4755-a8e0-9149260eef12.mp4"> | <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/e054e1a9-eb20-4ca6-be44-0ba9c7c07d50"> | <video src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/47fd5a98-ab0f-4c5c-b132-5d4b0aa02763.mp4"> |
|
||||
| --- | --- | --- | --- |
|
||||
| [➡️Open in Avatech Labs]() | [➡️Open in Avatech Labs]() | [➡️Open in Avatech Labs]() | [➡️Open in Avatech Labs]() |
|
||||
|
||||
# Contents
|
||||
- [Demo](#demo)
|
||||
- [Custom Nodes](custom-nodes)
|
||||
- [Workflow Template](workflow-template)
|
||||
- [Image Preprocess Guide](#image-preprocess-guide)
|
||||
- [Custom Nodes](custom-nodes)
|
||||
- [Shape Flow](#shape-flow)
|
||||
- [Installation](#installation)
|
||||
- [Development](#development)
|
||||
|
||||
# Custom Nodes
|
||||
[Image Segmentation Nodes](#image-segmentation-nodes) | [Mesh Edit Nodes](#mesh-edit-nodes) | [Shape Keys Nodes](#shape-keys-nodes) | [Avatar Output Nodes](#avatar-output-nodes)
|
||||
|
||||
<details>
|
||||
<summary> Expand to see all the available nodes description </summary>
|
||||
|
||||
## Image Segmentation Nodes
|
||||
| Name | Description | Preview |
|
||||
| ---------------------------- | ----------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ |
|
||||
| `Segmentation (SAM)` | Integrative SAM node allowing you to directly select and create multiple image segment output. | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/8aabeba8-5450-4d39-8203-e91f9ab47190" width="300"> |
|
||||
|
||||
## Mesh Edit Nodes
|
||||
| Name | Description | Preview |
|
||||
| ---------------------------- | ----------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ |
|
||||
| `Create Mesh Layer` | Create a mesh object from the input images (usually a segmented part of the entire image) | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/40740d25-9411-4cd3-a6c0-8b9008bca41c" width="300"> |
|
||||
| `Join Meshes` | Combine multiple meshes into a single mesh object | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/ba7afbc5-9cd5-4f97-9614-f71133f5783e" width="300"> |
|
||||
| `Match Texture Aspect Ratio` | Since the mesh is created in 1:1 aspect ratio, a re-scale is needed at the end of the operation | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/cb7155be-fb31-49f8-a24a-d001a1484ea7" width="300"> |
|
||||
| `Plane Texture Unwrap` | Will perform mesh face fill and UV Cube project on the target plane mesh, scaled to bounds. | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/4b9c0cf5-0497-47bf-8e06-5a3370084c11" width="300"> |
|
||||
|
||||
## Shape Keys Nodes
|
||||
| Name | Description | Preview |
|
||||
| ---------------------------- | ----------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ |
|
||||
| `Mesh Modify Shape Key` | Given shape key name & target vertex_group, modify the vertex / all vertex’s transform | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/ab4f259c-89a7-4f51-bc54-fd179e252073" width="300"> |
|
||||
| `Create Shape Flow` | Create runtime shape flow graph, allowing interactive inputs affecting shape keys value in runtime | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/abfdd801-0387-4c5d-9c11-6c23337ff1dd" width="300"> |
|
||||
|
||||
## Avatar Output Nodes
|
||||
| Name | Description | Preview |
|
||||
| ---------------------------- | ----------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ |
|
||||
| `Avatar Main Output` | The primary output of the .ava file. The embeded Avatar View will auto update with this node's output | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/6a9a8bb4-05ec-4a2e-98bf-194b6af3a62a" width="300"> |
|
||||
|
||||
</details>
|
||||
|
||||
# Workflow Template
|
||||
|
||||
## Simple Rig
|
||||
@@ -121,6 +90,38 @@ To enable the character to blink eyes and talking.
|
||||
>
|
||||
> </details>
|
||||
|
||||
# Custom Nodes
|
||||
[Image Segmentation Nodes](#image-segmentation-nodes) | [Mesh Edit Nodes](#mesh-edit-nodes) | [Shape Keys Nodes](#shape-keys-nodes) | [Avatar Output Nodes](#avatar-output-nodes)
|
||||
|
||||
<details>
|
||||
<summary> Expand to see all the available nodes description </summary>
|
||||
|
||||
## Image Segmentation Nodes
|
||||
| Name | Description | Preview |
|
||||
| ---------------------------- | ----------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ |
|
||||
| `Segmentation (SAM)` | Integrative SAM node allowing you to directly select and create multiple image segment output. | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/8aabeba8-5450-4d39-8203-e91f9ab47190" width="300"> |
|
||||
|
||||
## Mesh Edit Nodes
|
||||
| Name | Description | Preview |
|
||||
| ---------------------------- | ----------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ |
|
||||
| `Create Mesh Layer` | Create a mesh object from the input images (usually a segmented part of the entire image) | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/40740d25-9411-4cd3-a6c0-8b9008bca41c" width="300"> |
|
||||
| `Join Meshes` | Combine multiple meshes into a single mesh object | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/ba7afbc5-9cd5-4f97-9614-f71133f5783e" width="300"> |
|
||||
| `Match Texture Aspect Ratio` | Since the mesh is created in 1:1 aspect ratio, a re-scale is needed at the end of the operation | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/cb7155be-fb31-49f8-a24a-d001a1484ea7" width="300"> |
|
||||
| `Plane Texture Unwrap` | Will perform mesh face fill and UV Cube project on the target plane mesh, scaled to bounds. | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/4b9c0cf5-0497-47bf-8e06-5a3370084c11" width="300"> |
|
||||
|
||||
## Shape Keys Nodes
|
||||
| Name | Description | Preview |
|
||||
| ---------------------------- | ----------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ |
|
||||
| `Mesh Modify Shape Key` | Given shape key name & target vertex_group, modify the vertex / all vertex’s transform | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/ab4f259c-89a7-4f51-bc54-fd179e252073" width="300"> |
|
||||
| `Create Shape Flow` | Create runtime shape flow graph, allowing interactive inputs affecting shape keys value in runtime | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/abfdd801-0387-4c5d-9c11-6c23337ff1dd" width="300"> |
|
||||
|
||||
## Avatar Output Nodes
|
||||
| Name | Description | Preview |
|
||||
| ---------------------------- | ----------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------ |
|
||||
| `Avatar Main Output` | The primary output of the .ava file. The embeded Avatar View will auto update with this node's output | <img src="https://github.com/avatechai/avatar-graph-comfyui/assets/18395202/6a9a8bb4-05ec-4a2e-98bf-194b6af3a62a" width="300"> |
|
||||
|
||||
</details>
|
||||
|
||||
# Shape Flow
|
||||
|
||||
|
||||
|
||||
Reference in New Issue
Block a user