From 582115862df9743be7a101e5b0ab2be6dc3bd6af Mon Sep 17 00:00:00 2001 From: nullquant Date: Sat, 18 May 2024 21:36:52 +0300 Subject: [PATCH] readme: brushnet limitations --- README.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/README.md b/README.md index 0d6284b..3375c9a 100644 --- a/README.md +++ b/README.md @@ -217,6 +217,16 @@ You should try to add object description to negative prompt and describe empty s + +## Limitations + +BrushNet has some limitations (from the [paper](https://arxiv.org/abs/2403.06976)): + +- The quality and content generated by the model are heavily dependent on the chosen base model. +The results can exhibit incoherence if, for example, the given image is a natural image while the base model primarily focuses on anime. +- Even with BrushNet, we still observe poor generation results in cases where the given mask has an unusually shaped +or irregular form, or when the given text does not align well with the masked image. + ## Notes Unfortunately, due to the nature of BrushNet code some nodes are not compatible with these, since we are trying to patch the same ComfyUI's functions.