Negative-attention-for-ComfyUI-

Takes the difference in between the positive and negative conditioning at the cross attention.

A proof of concept which demonstrates that a negative influence can be obtained by taking the difference at the output of the cross attention.

In order to do this for now the negative conditioning is sneaked to the attention by being concatenated to the positive by using a special node.

They are then split at the half before the cross attention.

Like any model patcher, it is to be plugged right after the model loader:

An example workflow is provided.

Example:

No modification:

Strength at 2, rescale after ON:

Strength at 2, rescale after OFF:

Note

I haven't managed to make this work with anything but SDXL / SD1.5

I did spend two hours looking for how to patch the equivalent of the cross attention for Flux but did not find how (like the keywords for the patch or something).

Any help appreciated!