readme: brushnet limitations

2024-05-18 21:36:52 +03:00
parent 9f7a117ed4
commit 582115862d
1 changed files with 10 additions and 0 deletions
@@ -217,6 +217,16 @@ You should try to add object description to negative prompt and describe empty s

 </details>

+
+## Limitations 
+
+BrushNet has some limitations (from the [paper](https://arxiv.org/abs/2403.06976)): 
+
+- The quality and content generated by the model are heavily dependent on the chosen base model. 
+The results can exhibit incoherence if, for example, the given image is a natural image while the base model primarily focuses on anime. 
+- Even with BrushNet, we still observe poor generation results in cases where the given mask has an unusually shaped
+or irregular form, or when the given text does not align well with the masked image.
+
 ## Notes

 Unfortunately, due to the nature of BrushNet code some nodes are not compatible with these, since we are trying to patch the same ComfyUI's functions.