141 lines
7.9 KiB
Markdown
141 lines
7.9 KiB
Markdown
# Documentation
|
||
- Class name: samplerSettingsNoiseIn
|
||
- Category: EasyUse/PreSampling
|
||
- Output node: True
|
||
- Repo Ref: https://github.com/yolain/ComfyUI-Easy-Use.git
|
||
|
||
该节点旨在为采样过程配置和应用噪声设置，这可以增强生成样本的多样性和质量。它允许调整噪声因素和调度，有助于实现更精细和可控的生成工作流程。
|
||
|
||
# Input types
|
||
## Required
|
||
- pipe
|
||
- ‘pipe’参数是必要的，因为它携带了正在处理的模型和样本的必要信息。它是节点操作的支柱，促进了应用噪声和后续采样步骤所需的数据流。
|
||
- Comfy dtype: PIPE_LINE
|
||
- Python dtype: Dict[str, Any]
|
||
- factor
|
||
- ‘factor’参数在确定采样过程中引入的噪声程度方面至关重要。它直接影响原始噪声和变化噪声之间的平衡，从而影响最终输出的多样性和一致性。
|
||
- Comfy dtype: FLOAT
|
||
- Python dtype: float
|
||
- steps
|
||
- ‘steps’参数定义了采样过程将要经历的迭代次数。它很重要，因为它决定了采样的复杂性和深度，更多的步骤可能导致更精细的结果。
|
||
- Comfy dtype: INT
|
||
- Python dtype: int
|
||
- cfg
|
||
- ‘cfg’参数用于微调采样过程的配置。它在调整节点的整体行为方面发挥作用，确保采样按照期望的规格进行。
|
||
- Comfy dtype: FLOAT
|
||
- Python dtype: float
|
||
- sampler_name
|
||
- ‘sampler_name’参数在选择合适的采样方法方面至关重要。它影响生成样本时采用的策略，不同的采样器提供不同的噪声应用和样本多样性方法。
|
||
- Comfy dtype: COMBO
|
||
- Python dtype: str
|
||
- scheduler
|
||
- ‘scheduler’参数在管理采样步骤中噪声的应用方面很重要。它有助于控制引入噪声的速度，确保从采样过程的一个阶段平稳过渡到下一个阶段。
|
||
- Comfy dtype: COMBO
|
||
- Python dtype: str
|
||
- denoise
|
||
- ‘denoise’参数负责指定要应用的去噪水平。它影响生成样本的清晰度和锐度，较高的值导致更清晰的输出。
|
||
- Comfy dtype: FLOAT
|
||
- Python dtype: float
|
||
- seed
|
||
- ‘seed’参数对于确保采样过程中的可重复性至关重要。它初始化随机数生成器，允许在不同运行中使用相同设置时获得一致的结果。
|
||
- Comfy dtype: INT
|
||
- Python dtype: int
|
||
|
||
# Output types
|
||
- pipe
|
||
- ‘pipe’输出是输入‘pipe’的修改版本，现在包含调整后的噪声设置和生成的样本。它是节点处理的成果，封装了增强的采样数据以供进一步使用。
|
||
- Comfy dtype: PIPE_LINE
|
||
- Python dtype: Dict[str, Any]
|
||
|
||
# Usage tips
|
||
- Infra type: CPU
|
||
|
||
# Source code
|
||
```
|
||
class samplerSettingsNoiseIn:
|
||
|
||
def __init__(self):
|
||
pass
|
||
|
||
@classmethod
|
||
def INPUT_TYPES(cls):
|
||
return {'required': {'pipe': ('PIPE_LINE',), 'factor': ('FLOAT', {'default': 0.1, 'min': 0.0, 'max': 1.0, 'step': 0.01, 'round': 0.01}), 'steps': ('INT', {'default': 20, 'min': 1, 'max': 10000}), 'cfg': ('FLOAT', {'default': 8.0, 'min': 0.0, 'max': 100.0}), 'sampler_name': (comfy.samplers.KSampler.SAMPLERS,), 'scheduler': (comfy.samplers.KSampler.SCHEDULERS,), 'denoise': ('FLOAT', {'default': 1.0, 'min': 0.0, 'max': 1.0, 'step': 0.01}), 'seed': ('INT', {'default': 0, 'min': 0, 'max': MAX_SEED_NUM})}, 'optional': {'optional_noise_seed': ('INT', {'forceInput': True}), 'optional_latent': ('LATENT',)}, 'hidden': {'prompt': 'PROMPT', 'extra_pnginfo': 'EXTRA_PNGINFO', 'my_unique_id': 'UNIQUE_ID'}}
|
||
RETURN_TYPES = ('PIPE_LINE',)
|
||
RETURN_NAMES = ('pipe',)
|
||
OUTPUT_NODE = True
|
||
FUNCTION = 'settings'
|
||
CATEGORY = 'EasyUse/PreSampling'
|
||
|
||
def slerp(self, val, low, high):
|
||
dims = low.shape
|
||
low = low.reshape(dims[0], -1)
|
||
high = high.reshape(dims[0], -1)
|
||
low_norm = low / torch.norm(low, dim=1, keepdim=True)
|
||
high_norm = high / torch.norm(high, dim=1, keepdim=True)
|
||
low_norm[low_norm != low_norm] = 0.0
|
||
high_norm[high_norm != high_norm] = 0.0
|
||
omega = torch.acos((low_norm * high_norm).sum(1))
|
||
so = torch.sin(omega)
|
||
res = (torch.sin((1.0 - val) * omega) / so).unsqueeze(1) * low + (torch.sin(val * omega) / so).unsqueeze(1) * high
|
||
return res.reshape(dims)
|
||
|
||
def prepare_mask(self, mask, shape):
|
||
mask = torch.nn.functional.interpolate(mask.reshape((-1, 1, mask.shape[-2], mask.shape[-1])), size=(shape[2], shape[3]), mode='bilinear')
|
||
mask = mask.expand((-1, shape[1], -1, -1))
|
||
if mask.shape[0] < shape[0]:
|
||
mask = mask.repeat((shape[0] - 1) // mask.shape[0] + 1, 1, 1, 1)[:shape[0]]
|
||
return mask
|
||
|
||
def expand_mask(self, mask, expand, tapered_corners):
|
||
try:
|
||
import numpy as np
|
||
import scipy
|
||
c = 0 if tapered_corners else 1
|
||
kernel = np.array([[c, 1, c], [1, 1, 1], [c, 1, c]])
|
||
mask = mask.reshape((-1, mask.shape[-2], mask.shape[-1]))
|
||
out = []
|
||
for m in mask:
|
||
output = m.numpy()
|
||
for _ in range(abs(expand)):
|
||
if expand < 0:
|
||
output = scipy.ndimage.grey_erosion(output, footprint=kernel)
|
||
else:
|
||
output = scipy.ndimage.grey_dilation(output, footprint=kernel)
|
||
output = torch.from_numpy(output)
|
||
out.append(output)
|
||
return torch.stack(out, dim=0)
|
||
except:
|
||
return None
|
||
|
||
def settings(self, pipe, factor, steps, cfg, sampler_name, scheduler, denoise, seed, optional_noise_seed=None, optional_latent=None, prompt=None, extra_pnginfo=None, my_unique_id=None):
|
||
latent = optional_latent if optional_latent is not None else pipe['samples']
|
||
model = pipe['model']
|
||
(batch_size, _, height, width) = latent['samples'].shape
|
||
generator = torch.manual_seed(seed)
|
||
base_noise = torch.randn((1, 4, height, width), dtype=torch.float32, device='cpu', generator=generator).repeat(batch_size, 1, 1, 1).cpu()
|
||
if optional_noise_seed is None or optional_noise_seed == seed:
|
||
optional_noise_seed = seed + 1
|
||
generator = torch.manual_seed(optional_noise_seed)
|
||
variation_noise = torch.randn((batch_size, 4, height, width), dtype=torch.float32, device='cpu', generator=generator).cpu()
|
||
slerp_noise = self.slerp(factor, base_noise, variation_noise)
|
||
end_at_step = steps
|
||
start_at_step = round(end_at_step - end_at_step * denoise)
|
||
device = comfy.model_management.get_torch_device()
|
||
comfy.model_management.load_model_gpu(model)
|
||
model_patcher = comfy.model_patcher.ModelPatcher(model.model, load_device=device, offload_device=comfy.model_management.unet_offload_device())
|
||
sampler = comfy.samplers.KSampler(model_patcher, steps=steps, device=device, sampler=sampler_name, scheduler=scheduler, denoise=1.0, model_options=model.model_options)
|
||
sigmas = sampler.sigmas
|
||
sigma = sigmas[start_at_step] - sigmas[end_at_step]
|
||
sigma /= model.model.latent_format.scale_factor
|
||
sigma = sigma.cpu().numpy()
|
||
work_latent = latent.copy()
|
||
work_latent['samples'] = latent['samples'].clone() + slerp_noise * sigma
|
||
if 'noise_mask' in latent:
|
||
noise_mask = self.prepare_mask(latent['noise_mask'], latent['samples'].shape)
|
||
work_latent['samples'] = noise_mask * work_latent['samples'] + (1 - noise_mask) * latent['samples']
|
||
work_latent['noise_mask'] = self.expand_mask(latent['noise_mask'].clone(), 5, True)
|
||
if pipe is None:
|
||
pipe = {}
|
||
new_pipe = {'model': pipe['model'], 'positive': pipe['positive'], 'negative': pipe['negative'], 'vae': pipe['vae'], 'clip': pipe['clip'], 'samples': work_latent, 'images': pipe['images'], 'seed': seed, 'loader_settings': {**pipe['loader_settings'], 'steps': steps, 'cfg': cfg, 'sampler_name': sampler_name, 'scheduler': scheduler, 'denoise': denoise, 'add_noise': 'disable'}}
|
||
return (new_pipe,)
|
||
``` |