๐ฎ Introduction โจ The Essence of Noise
+ShaderNoiseKSampler is a ComfyUI node that uses shader algorithms to generate and control procedural noise. This noise, refeered to as shader noise, can then be used to influence the AI image creation process in latent diffusion models. The aim is to provide a way to introduce structured mathematical patterns into the diffusion process, offering a different approach to guiding image generation.
+This document outlines the features, technical details, and underlying ideas of ShaderNoiseKSampler, showing how different shader noise types can create various visual characteristics that influence and drive the diffusion process.
+ +๐ The Path of Noise
+Noise is fundamentally a mathematical expression of ordered chaosโa seemingly random pattern that nonetheless follows precise mathematical rules. In the context of image generation, these noise patterns serve as the seed from which creation emerges. ShaderNoiseKSampler allows artists to shape this primordial mathematical chaos according to sacred geometric principles, guiding the diffusion model\'s sampling process along specific aesthetic trajectories.
+Just as ancient civilizations recognized patterns in nature and encoded them in their art and architecture, ShaderNoiseKSampler enables digital artists to encode mathematical archetypes into the generative process, creating a bridge between abstract mathematics and visual expression.
+๐ Project Genesis โThe Birth of Order from Chaos
+ +๐๏ธ The Vision Unveiled
+The genesis of ShaderNoiseKSampler lies in a contemplation of nature\'s fundamental paradox: the inherent order within apparent chaos. Observing the natural world reveals that seemingly random phenomenaโthe flicker of fire, the branching of lightning, the flow of water, the structure of terrestrial formsโall exhibit underlying fractal patterns. This ubiquitous principle, that profound order underpins apparent disorder, became a guiding inspiration.
+The initial conceptual spark was hyperspaceโan unseen realm between dimensions. While seemingly chaotic in its construct, closer examination reveals a perfect, almost unimaginable mathematical precision and scope. It is this notion that the unseen can be rendered observable with the appropriate tools which led to a pivotal question: Could a method be devised to introduce deliberate order into random noise? Could one inject structure into the latent space itself, thereby crystallizing defined pathways for creative generation?
+๐๏ธ The Ant Colony Revelation
+A compelling metaphor emerged from an unexpected source: the art of ant sculpture. This process, which captures the hidden architecture of ant tunnels by filling them with molten metal, offered a tangible analogy. Once cooled and excavated, the metal cast reveals a previously unseen, complex structureโa physical manifestation of the colony\'s hidden pathways. The question then became: how could one create a virtual equivalent of this molten metal? The answer was clear: Shaders.
+ +Shader patterns, like molten metal, flow into and define the pathways within latent space.
The K-sampling process allows this structured noise to effectively \'solidify\' within the latent dimensions.
As the model denoises, it progressively reveals the crystallized patterns embedded by the shader.
The output is a manifestation of a previously unseen space, a navigable pathway forged through the realm of possibility.
โ๏ธ The Alchemical Process: From Theory to Practice
+The journey from concept to a functional implementation involved extensive experimentation, iterative debugging, and countless visualization tests. The challenge was multifaceted, encompassing not only technical hurdles but also philosophical considerations: How could the abstract vision of controlled chaos be translated into robust code? Critically, how could novel structures be introduced without disrupting the model\'s foundational training?
+A crucial breakthrough was the understanding that models cannot be expected to produce coherent results when fed noise types entirely alien to their training data. This led to the principle of augmentation rather than replacement. The final noise input to the KSampler is therefore not a wholesale substitution but a careful modification of the standard base noise. The shader noise augments and sculpts this base noise, and the influence of these shader-defined patterns began to yield compelling and controllable results in the generated outputs.
+This hybrid methodologyโa delicate equilibrium between the familiar (the model\'s learned representations) and the novel (the intentionally introduced structure)โfosters both generative stability and exploratory capacity.
+Respecting a model\'s training by blending shader-generated noise with the base noiseโas opposed to outright replacementโis a cornerstone of ShaderNoiseKSampler. This approach preserves generative coherence while enabling nuanced, controllable structural influence.
++ Not to eliminate randomness, but to make it purposeful
+ To transform noise into navigation, and navigation into art"
+ โ The Genesis Vision +
๐บ๏ธ Exploring Latent Space: A Developing Idea
+The exploration extended to the nature of latent space. It became apparent that by adjusting shader noise parameters with a consistent seed, one could systematically alter the generative output. This suggested a way to modify not just noise characteristics, but potentially the "topology" of the latent space being explored.
+This led to an interesting mode of exploration. It was observed that different seeds seemed to contain unique thematic elementsโrecurring characters, color palettes, objects, and stylesโthat could be traced and explored. ShaderNoiseKSampler evolved from a noise tool into a means of navigating within a model's latent space with more specific control. This helped clarify the tool's potential.
+Each parameter adjustment can be seen as a step along conceptual pathways, each blend mode a different way to perceive and traverse the possibilities.
+ +๐ Core Concept โณ The Alchemical Transformation
+ShaderNoiseKSampler implements the formula Lt=Sฮฑ(N)โKฮฒ(t)โa mathematical invocation where structured noise Sฮฑ transforms the base noise N before it enters the diffusion sampling process Kฮฒ. This elegant formula captures the essence of guided chaos, where randomness is structured according to sacred patterns before manifesting in the final image.
The core equation Lt=Sฮฑ(N)โKฮฒ(t) can be understood as follows:
Where:
+-
+
- Lt: The final latent representation at timestep t +
- Sฮฑ(N): The shader transformation with parameters ฮฑ applied to base noise N +
- Kฮฒ(t): The diffusion sampling process with parameters ฮฒ at timestep t +
- โ: Function composition operator (application of one function to the result of another) +
This mathematical formulation allows for more precise control over the noise structures that guide the generative process, creating a harmony between randomness and order.
+โ๏ธ The Role of ShaderToTensor: Bridging Code and Concept
+The ShaderToTensor class, implemented in shader_to_tensor.py, is the cornerstone of this system\'s ability to translate abstract shader concepts into concrete PyTorch tensors. It acts as the alchemical crucible where mathematical descriptions of noise are transmuted into the actual structured noise (Sฮฑ in our formula) that the KSampler can utilize.
Key functions of ShaderToTensor include:
-
+
- Noise Synthesis: It contains the Python and PyTorch implementations of various noise algorithms (Perlin, Cellular, Curl, etc.). When you select a \'Shader Noise Type\' in the UI, you\'re choosing a specific method within this class. +
- Parameter Interpretation: It takes the parameters you set (Scale, Octaves, Warp Strength, etc.) and uses them to control the generation of these noise tensors. +
- Tensor Formatting: It ensures the generated noise is in the correct format (shape, data type, device) to be compatible with the ComfyUI latent workflow and the KSampler. This includes handling channel expansion (e.g., from 1-channel noise to 4 or 9 channels for the latent space). +
- Temporal Coherence Logic: For animated noise,
ShaderToTensor(often in conjunction with specialized generator classes) implements the logic to produce evolving noise patterns over a time dimension.
+
Essentially, ShaderToTensor is the engine that powers the Sฮฑ(N) part of the equation. Without it, the conceptual shader patterns would remain abstract; this class makes them tangible and usable by the diffusion model.
๐ Essential Parameters
+The fundamental pattern archetype (tensor_field, curl_noise, domain_warp, etc.)
+Controls the frequency of pattern repetition (1.0 is the harmonic baseline)
+The number of recursive self-similar layers (follows Fibonacci principles)
+Controls the amount of displacement or distortion applied to the noise coordinates, altering the pattern's structure.
+Adjusts the input to the noise function, effectively shifting the generated pattern. This can be used to explore variations of the noise.
+The geometric form overlaid upon the noise (radial, spiral, hexgrid, etc.)
+Controls the intensity of the shape mask, determining how much of the noise is affected by the mask.
+Mathematical operations (e.g., absolute, sin, sqrt) applied to the shader noise before blending. [Recommended: Experiment freely. See 'Noise Transformations' section for details].
+The alchemical method of combining shader noise with base noise (multiply, add, etc.). [Recommended: Multiply, Normal, Screen, Overlay].
+Adjusts the impact of the selected color scheme on the noise pattern.
+Number of sequential shader stages to apply before injection stages. Each stage can have varied strength and apply noise over a specific portion of the diffusion steps. [Recommended: 1 - 3].
+Number of injection shader stages to apply after sequential stages. These stages typically inject noise at specific steps within the diffusion process, allowing for targeted interventions. [Recommended: 0 - 2].
+Overall strength of the shader noise influence for all stage types. Set to 0.0 to disable shader noise and use only the base noise. This acts as a global multiplier for stage-specific strengths. [Recommended: 0.1 - 0.4].
+Classifier-Free Guidance scale. [Recommended: 6 - 9].
+Number of sampling iterations. [Recommended: 20 - 60].
+๐ต๏ธ Shader Noise Patterns โง The Twelve Noise Archetypes
+ShaderNoiseKSampler harnesses twelve fundamental shader noise archetypes, each channeling a different aspect of mathematical reality. These patterns are the building blocks of visual coherence, from the flowing whorls of Perlin noise to the cosmic web-like structures of Tensor Fields. Each archetype generates its own distinct style of noise, offering a diverse palette for visual expression.
+ +
๐ Unlock Exclusive Shader Noise Palettes!
+Become a valued member to access an expanded library of unique shader noise archetypes, advanced shader features, and custom ComfyUI tools. Your support helps fuel further development!
+โ๏ธ Noise Mathematics ๐ The Underlying Formulations
+Each shader noise archetype in ShaderNoiseKSampler is built upon rigorous mathematical foundations. Understanding these mathematical principles reveals the sacred geometry inherent in these patterns and allows for more intentional application in the creative process.
+ +Perlin Noise Mathematics
+Perlin noise, developed by Ken Perlin in 1983, uses a grid of random gradient vectors with interpolation to create smooth, natural-looking noise. The core computation involves:
+Where gi are random gradient vectors at grid points, and ฯi are interpolation weights. The smoothstep function provides the basis for the interpolation:
+This smooth interpolation creates the characteristic flowing appearance of Perlin noise, making it ideal for natural phenomena like terrain, clouds, and flowing water.
+Cellular Noise Mathematics
+Cellular noise (also known as Worley noise) creates Voronoi-like patterns based on distance metrics to feature points:
+Where dist() is a distance function (typically Euclidean) and Fn returns the distance to the nth closest feature point. Various cellular patterns emerge by combining these distances:
++ F1 : cell interiors
+ 2F1 - F2 : cracks +
These combinations create patterns reminiscent of cellular structures, bubbles, and organic tissues.
+Tensor Field Mathematics
+Tensor fields represent directional information at every point in space, creating flow-like patterns. The core mathematics involves computing the eigenvalues ฮป and eigenvectors v of tensor matrices:
+The eigenvalues and eigenvectors are found by solving:
+Different visualizations emerge based on how we render these tensor properties:
+-
+
- Eigenvalue visualization: Shows magnitude of deformation +
- Streamlines: Shows direction of principal stress +
- Hyperstreamlines: Combines both with weighted influence +
- Ellipses: Represents the tensor as oriented ellipses +
Curl Noise Mathematics
+Curl noise generates divergence-free vector fields, perfect for fluid-like motions. It\'s based on the curl operator from vector calculus:
+In 2D, this simplifies to a scalar field where the curl is perpendicular to the plane:
+This mathematical property ensures the resulting vector field has zero divergence (โยทv = 0), creating perfect flow patterns without sources or sinks.
+Domain Warp Mathematics
+Domain warping is a technique where the input coordinates (the domain) of a noise function are displaced or distorted by another noise function. This creates swirling, turbulent, or flowing effects in the final pattern. Instead of sampling noise at point P, we sample at P + offset(P), where offset(P) is itself a noise function.
+Where:
+-
+
- P: The input coordinate (e.g., (x,y)). +
- Noisebase: The primary noise function (e.g., Perlin, Simplex). +
- Noisedisplacement: A noise function generating the offset vectors. +
- Swarp: Warp strength, controlling the magnitude of distortion. +
- Fwarp: Warp frequency, controlling the detail of the distortion. +
By applying this recursively (warping the domain of the displacement noise itself), more complex fractal warping effects can be achieved.
+Fractal Noise (FBM) Mathematics
+Fractal noise, often implemented as Fractal Brownian Motion (FBM), is a fundamental technique for generating natural-looking textures. It is constructed by summing multiple layers (octaves) of a base noise function (like Perlin or Simplex). Each successive octave has a higher frequency and a lower amplitude.
+Where:
+-
+
- P: The input coordinate. +
- N: The number of octaves (layers of detail). +
- Noise: The base coherent noise function (e.g., Perlin). +
- A: Amplitude factor (persistence, typically < 1, e.g., 0.5). Controls how much amplitude decreases per octave. +
- F: Frequency factor (lacunarity, typically > 1, e.g., 2.0). Controls how much frequency increases per octave. +
The summation creates a pattern that exhibits self-similarity across different scales, characteristic of many natural phenomena.
+Waves Noise Mathematics
+Waves noise is typically generated by summing multiple sine or cosine wave functions. Each wave can have its own amplitude, frequency, phase, and direction. The superposition of these waves can create a wide variety_of_patterns, from simple ripples to complex interference effects.
+Where for each wave i:
+-
+
- P: The input coordinate (e.g., (x,y)). +
- Ai: Amplitude of the wave. +
- ki: Wave vector (determines direction and spatial frequency/wavelength). Its magnitude |ki| = 2ฯ / ฮปi. +
- ฯi: Angular frequency (determines temporal oscillation speed). +
- t: Time. +
- ฯi: Phase offset. +
- โ : Dot product. +
Simpler forms might fix directions or use scalar frequencies if directionality is not complex.
+Gaussian Noise Mathematics
+Gaussian noise is a statistical noise characterized by a probability density function (PDF) that follows the Gaussian (or normal) distribution. Its values are typically clustered around a mean (ฮผ), with a spread determined by the standard deviation (ฯ). In image processing, it's often used to simulate random sensor noise or as a basis for other effects.
+For generating Gaussian noise, random numbers are drawn from this distribution. In practice, libraries provide functions to directly generate such noise (e.g., torch.randn which samples from N(0,1)).
-
+
- ฮผ (Mean): The average value, often 0 for noise. +
- ฯ (Standard Deviation): Controls the "spread" or intensity of the noise. ฯ2 is the variance. +
Gaussian noise is "white" if its values are statistically independent and identically distributed at each point.
+Heterogeneous FBM Mathematics
+Heterogeneous Fractal Brownian Motion (Hetero FBM) is an extension of standard FBM. While standard FBM uses constant parameters (like persistence/amplitude falloff and lacunarity/frequency gain) across all octaves and spatial locations, Hetero FBM allows these parameters, or the base noise characteristics, to vary spatially. This creates textures with non-uniform complexity, where some areas might be smoother and others rougher or more detailed.
+Where:
+-
+
- P: The input coordinate. +
- N: The number of octaves. +
- A(P, i): Spatially varying amplitude for octave i at point P. +
- F(P, i): Spatially varying frequency for octave i at point P. +
- Noise(..., params(P,i)): Base noise function whose own internal parameters might also vary spatially. +
The spatial variation itself is often controlled by another noise function or a predefined map. For example, the Hurst exponent (H), which relates to persistence, could be made to vary across the domain.
+Interference Noise Mathematics
+Interference patterns arise from the superposition of two or more waves. When waves meet, they can reinforce each other (constructive interference) or cancel each other out (destructive interference), depending on their relative phases and amplitudes. This principle is fundamental in physics (e.g., light and sound waves) and can be used to generate complex visual patterns.
+A common way to generate interference is by summing or multiplying wave functions:
+Example with two sine waves:
+Or using noise functions as sources:
+Where S is a scale and O is an offset for Noise2 to make it different from Noise1. The visual character depends heavily on the frequencies and relative phases of the interfering sources.
+Spectral Noise Mathematics
+Spectral noise generation involves directly defining or manipulating the noise's properties in the frequency domain (its spectrum) using techniques like the Fourier Transform. By controlling the amplitude and phase of different frequencies, a wide variety_of_textures can be created, from smooth to rough, or with specific directional biases.
+The general process is:
+-
+
- Start with white noise in the spatial domain or directly create a spectrum. +
- Compute its Fast Fourier Transform (FFT) to get the frequency domain representation (spectrum). +
- Modify the spectrum: Apply a filter (e.g., 1/fฮฒ for pink/brown/blue noise, band-pass, directional filters). +
- Compute the Inverse Fast Fourier Transform (IFFT) to convert the modified spectrum back to the spatial domain. +
The filter often takes the form 1/fฮฒ, where f is frequency and ฮฒ controls the "color" of the noise (e.g., ฮฒ=0 for white, ฮฒ=1 for pink, ฮฒ=2 for brown/red).
+3D Projection Noise Mathematics
+3D Projection noise involves generating a 3D noise field (e.g., 3D Perlin, Simplex, or FBM) and then sampling a 2D slice from it. This technique creates 2D patterns that appear to have depth, volume, or temporal evolution if the slice position changes over time.
+Where:
+-
+
- (x, y): 2D coordinates for the output noise. +
- Noise3D: A 3D coherent noise function. +
- Sxy: Spatial scaling factor for x and y axes. +
- zslice: The depth or position of the 2D slice along the third dimension (often z). +
- Sz: Scaling factor for the z-dimension, controlling "thickness" or detail along z. +
- T: Time parameter for animation. +
- Vt: Velocity of slicing through the 3D noise field over time. +
By animating zslice or rotating the sampling plane, dynamic evolving textures can be created from a static 3D noise volume.
+๐ญ Blend Modes โ๏ธ The Alchemical Combinations
+ShaderNoiseKSampler offers various blend modes to combine shader noise with base noise, each creating distinct alchemical transformations:
+ +๐งฉ Blend Operations
+Simple linear interpolation between base and shader noise, controlled by shader_strength
+Adds shader noise to base noise, creating brightened areas where patterns align
+Multiplies base and shader noise, darkening the overall pattern
+Inverts, multiplies, then inverts again, brightening patterns
+Combines Multiply and Screen modes for enhanced contrast
+Darkens or lightens colors depending on shader noise
+More intense version of Overlay with sharper contrast
+Subtracts darker color from lighter color, creating distinctive edges
+๐งฟ Blend Mode Harmonics
+The choice of blend mode significantly impacts the generated image. Different blend modes resonate with different shader noise types and prompt themes:
+-
+
- Multiply + Cellular Noise โถ Organic, tissue-like structures +
- Add + Curl Noise โถ Ethereal, flowing energy patterns +
- Overlay + Tensor Field โถ Crystalline, structured patterns +
- Soft Light + Domain Warp โถ Dream-like, fluid transformations +
- Difference + Spectral Noise โถ Boundary-focused, edge-highlighting patterns +
Experiment with these combinations to find the blend harmonics that resonate with your artistic vision.
+๐ Noise Transformations ๐ Mathematical Metamorphosis
+Beyond the core shader noise patterns, ShaderNoiseKSampler offers additional mathematical transformations that can dramatically alter the character of the generated shader noise:
+ +๐งฎ Mathematical Operators
+Inverts the sign of the noise, turning peaks into valleys and vice versa
+Reverses the values within the 0-1 range, preserving the overall pattern
+Takes the absolute value, creating sharp ridges at zero-crossings
+Squares the values, enhancing high values and diminishing low values
+Takes the square root, enhancing low values and compressing high values
+Takes the logarithm, greatly enhancing low values
+Applies the sine function, creating oscillating patterns
+Applies the cosine function, creating alternating bands
+๐งช Transformation Alchemy
+These transformations can dramatically alter the character of shader noise patterns, creating new structural properties:
+-
+
- Absolute transform creates ridge-like features along zero-crossings, perfect for geological formations +
- Square transform enhances high-intensity regions while subduing low-intensity areas, ideal for creating focused areas of interest +
- Sin/Cos transforms create banded patterns, excellent for stratified or layered structures +
- Log transform magnifies subtle details in low-intensity regions, revealing hidden structures +
These transformations can be combined with different shader noise types and blend modes to create an almost infinite variety of structural guidance patterns.
+๐ฌ Temporal Coherence โณ Evolving Noise for Animations
+ShaderNoiseKSampler's temporal coherence feature ensures consistent noise patterns. For sequences like video frames, it helps maintain frame-to-frame consistency by evolving noise naturally over time. For single image generations, it ensures the base noise is derived consistently from the main seed, leading to predictable noise structures when parameters are tweaked.
+ +โ๏ธ Enabling Evolving Animations
+Temporal coherence fundamentally changes how shader noise is generated:
+-
+
use_temporal_coherence(Boolean): This is the primary toggle. When enabled, ShaderNoiseKSampler ensures noise is generated consistently. For videos, it uses techniques (like theTemporalCoherentNoiseGenerator) that treat time as an evolving dimension. For images, it ensures the same base noise is used if the main seed is unchanged.
+ - Consistent Base Seed: For temporal coherence to be effective (for both images and videos), the main
seedinput must remain constant. For videos, variation then comes from the noise evolving over an internal 'time' parameter. For images, this ensures that if other shader parameters are changed, the underlying base noise structure remains the same.
+ - Consistent/Evolving Patterns: For videos, this mode generates patterns that transform coherently from one frame to the next, leading to more stable animations. For single images, it means the generated noise pattern will be the same for a given seed, even if other parameters (like shader strength or blend mode) are changed, allowing for more predictable exploration. +
Conceptual animation preview placeholder.
+๐ญ Shape Masks ๐ Geometric Modulation
+Shape masks provide spatial control by modulating shader noise patterns with procedurally generated geometric overlays. These masks, typically grayscale tensors (0.0 for no effect, 1.0 for full effect), guide the generative process, influencing compositions and textural details.
+ +Mask Generation & Application
+Shape masks are procedurally generated within the node as fixed grayscale patterns where values range from 0.0 (no effect area) to 1.0 (full effect area). The generated mask \( M \) is then used to modulate an input field (e.g., a noise or velocity field \( V \)) based on the shape_mask_strength \( \\alpha_s \). The application is a linear interpolation:
This means if \( \\alpha_s = 1 \), the field is fully multiplied by the mask pattern (\( V \\times M \)). If \( \\alpha_s = 0 \), the mask has no effect. Intermediate values blend between the original and the mask-modulated field. Key characteristics include:
+-
+
- Mask Type: Defines the base geometry from a selection including Radial, Linear, and various Geometric or Procedural patterns. +
- Mask Strength: The \( \\alpha_s \) parameter, controlling the blend intensity of the mask\'s effect. +
- Edge Handling: Mask types inherently produce different edge styles, some with soft, feathered falloffs (often using
smoothstepinternally) and others with hard, thresholded edges.
+
Note that while masks might appear animated in visualization previews, in the backend implementation they are static patterns applied at generation time. Any animation effects in the final output would come from changing parameters between frames.
+ + + +๐จ Creative Applications
+The interplay between different mask types, the noise they modulate, and various parameter settings (like shape_mask_strength, noise_scale, etc.) allows for a wide range of artistic effects. Consider these combinations:
-
+
- Vignettes & Focus: Soft Radial or Vignette masks to draw attention centrally. +
- Structured Organics: Grid Masks combined with Cellular Noise for bio-mechanical effects. +
- Atmospheric Depth: Linear Gradient Masks to simulate fog or distance with flowing noise. +
- Selective Detailing: Geometric Masks to apply high-frequency noise to specific regions. +
Experiment with mask types and their strengths in conjunction with noise parameters to guide the generative process.
+๐ Color Schemes โ๏ธ Chromatic Adjustments
+ShaderNoiseKSampler allows for the application of color transformations directly to the generated shader noise patterns. It's important to understand that this is not a traditional post-processing color adjustment. Instead, the color information is integrated into the shader noise before it influences the diffusion model during the sampling process. Consequently, these 'colors' can function as an integral part of the shader noise's texture and structure, subtly guiding the model's interpretation and shaping the features, patterns, and overall aesthetic of the final image. This technique offers a unique way to enhance visual impact and steer the generative outcome.
+ +Color Transformation Process
+The color mapping function transforms a normalized noise value t โ [0,1] into RGB color space through gradient functions. Each color scheme defines specific transfer functions for each channel, creating distinctive visual characteristics that can alter how the diffusion model interprets the noise structure.
+ +Key characteristics of the coloring process include:
+-
+
- Color Scheme Selection: Different schemes provide various perceptual encodings of the noise data. +
- Color Intensity: Controls how strongly the coloring affects the final noise blend, typically between 0.0 (no effect) and 1.0 (full effect). +
- Channel Blending: The colored information is blended into the noise channels before they influence the diffusion process. +
Applying Color Schemes
+ShaderNoiseKSampler allows for the selection of various color schemes that are applied to the generated noise. The intensity of this coloration can also be controlled, determining how strongly the chosen color scheme influences the noise that guides the diffusion model.
+ +Color Scheme Effects on Generation
+-
+
- Contrast Enhancement: Color schemes like Inferno and Jet can increase the perceived contrast in the noise pattern, potentially leading to more defined boundaries in the generated image. +
- Perceptual Organization: Schemes like Viridis and Turbo help to organize the noise data perceptually, which can influence how the model interprets spatial relationships. +
- Mood and Tone: The predominant hues of a color scheme can subtly influence the mood or tonal quality of the generated image, even when the colors themselves aren't directly visible. +
- Detail Emphasis: Some schemes are better at emphasizing small details within the noise pattern, which can lead to enhanced textural complexity in the final output. +
๐ ๏ธ Usage ๐ง Working with this Tool
+ShaderNoiseKSampler integrates advanced noise generation directly into the ComfyUI sampling process. It replaces the standard KSampler's noise generation with a sophisticated system that allows for multi-stage shader application, diverse noise types, transformations, and blending, offering fine-grained control over the creative output.
+ +Core Workflow Integration
+-
+
- Connect Inputs:
+
-
+
model: The primary AI model for generation.
+ positive&negative: Conditioning prompts.
+ latent_image: The input latent to be processed.
+
+ - Basic Sampling Parameters:
+
-
+
seed: For reproducibility use a fixed seed value for consistent results.
+ steps: Number of sampling iterations.
+ cfg: Classifier-Free Guidance scale.
+ sampler_name&scheduler: Standard KSampler choices.
+ denoise: Controls the extent of denoising.
+
+ - Shader Noise Configuration: This is where ShaderNoiseKSampler shines:
+
-
+
sequential_stages: Number of shader stages applied sequentially over defined step ranges.
+ injection_stages: Number of shader stages applied at specific injection points during sampling.
+ shader_strength: Global strength of the shader noise influence. Set to 0.0 to use only base noise.
+ blend_mode: How shader noise combines with base noise (e.g., multiply, add, overlay).
+ noise_transform: Mathematical operations applied to the generated noise (e.g., absolute, sin, sqrt).
+ use_temporal_coherence: For generating frame-consistent noise, useful in animations.
+
+ - (Optional) Advanced Control:
+
-
+
custom_sigmas: Provide a custom sigma schedule to override the model's default.
+
+ - Run Workflow: Execute the ComfyUI graph. The ShaderNoiseKSampler will dynamically generate and blend noise according to your settings throughout the sampling process. +
โ๏ธ Key Parameter Explanations
+sequential_stages apply shader noise over segments of the diffusion process. The total steps are divided among these stages.
+ injection_stages apply shader noise at specific, discrete steps.
+ Sequential stages don't seem to add time to the generation but injection stages will add some time to the generation.
+
shader_strength is a global multiplier. Higher shader strength can lead to increased artifacting or generational oddities, but not always and not with all models or shader noise types. Small variations in shader strength is a good way to maintain the sum concepts of an image and not heavily vary its degree of difference.
The noise_transform (e.g., absolute, sin, sqrt) is a global setting applied to the generated shader noise within each stage before it's blended with the base noise. The chosen transformation is used consistently across all stages.
When use_temporal_coherence is enabled, the node aims to generate consistent noise. For videos, this means noise evolves smoothly over a "time" dimension (often using 3D/4D noise with one dimension as time), with the base seed consistent across frames. For images, it ensures the noise pattern is consistently derived from the main seed, even with other parameter changes.
custom_sigmas allows advanced users to define their own noise schedule (sigmas), giving more control over how noise is added and removed at each step. This can significantly alter the sampling dynamics.
The blend_mode (e.g., multiply, add, overlay) is a global setting that determines how the shader noise combines with the base noise. This selected blend mode is used for all stages.
๐ง Creative Techniques & Advanced Usage
+-
+
- Shader Visualizer as a Guide: Using the shader visualizer in connection to the generation process is crucial for gaining insights into your parameter adjustments. The shader display was designed as a visual aid, not just for presentation. It helps you understand the shader noise\'s impact on the output image and serves as a navigational tool for latent space, mirroring backend shader parameters. +
- Detail through Noise Scale & Octaves: Higher noise scale and octaves can contribute to more detailed images. Essentially, a more "noisy" input increases the likelihood of observing finer-grained detail in the output. +
- Parameter Interdependence: Parameters are not always independent. If phase shift adjustments seem insufficient, try incorporating a bit of warp strength. Conversely, if your noise scale and octaves are already high, parameters like warp strength and phase shift might appear less impactful. +
- Color Intensity with Shape Masks: Color intensity is only effective when a shape mask is active. Once active, it can be used to introduce subtle to significant variations in your image, depending on the input values. +
- Shape Mask Strength: Similar to color intensity, shape mask strength is only usable when a shape mask is active. When enabled, it allows for small to large image variations based on your input values. +
- Warp & Phase with Active Masks/Colors: You might notice that when a color scheme or a shape mask (especially with higher strength/intensity) is active, the perceptual impact of
warp_strengthandphase_shiftcan seem diminished. This is likely because the structural influence of the mask or the channel modifications from coloring are significantly shaping the noise, potentially overshadowing the more subtle distortions or shifts from warp and phase. Experiment with moderating mask/color influence if you need to bring out the warp/phase effects more clearly.
+ - Quick Ideation: For rapid idea generation without the need to constantly save parameters, consider using the (direct) version of this node. As is rapid parameter changes cannot be made to queue in succession, due to the way the node is currently implemented. +
- Saving Parameters: The "Save Shader Parameters" button (found on the ShaderNoiseKSampler node) allows you to save your current shader settings. These are saved to
custom_nodes/ComfyUI-ShaderNoiseKsampler/data/shader_params.json. Note: this file must be named exactlyshader_params.jsonin this specific directory and will be overwritten on each save. This is crucial for features that load these parameters. Use the (direct) version of this node to avoid saving parameters.
+ - Shader Noise Palettes & Performance: Each Shader Noise Type (or palette) offers a distinct lens through which to explore the latent space, revealing different facets and possibilities within a seed. Most shader noise types process at roughly comparable speeds, typically adding only about 3-4 seconds to the generation time compared to a standard KSampler. While some may occasionally take a moment longer to initialize or load, the overall impact on generation time is generally minimal. +
๐ Conclusion โฏ The Path of Creation
+ShaderNoiseKSampler is a bridge between the mathematical sublime and practical artistry. By understanding and harnessing the sacred geometry of shader noise, artists can guide the generative process with precision and intentionality, transforming pure mathematical concepts into tools of creative expression.
+It is important to note that this project represents a concept in its infancyโa minimal viable product of ongoing research. Much remains to be explored and understood in this fascinating intersection of mathematical noise patterns and generative art. The techniques and approaches presented here are foundational stepping stones in a journey that has only just begun.
+This work constitutes original, independent investigation and implementationโa product of genuine curiosity and hands-on experimentation rather than an adaptation of existing research. The path forward relies on community support, both in collaborative exploration and financial backing, to fuel further innovation. By supporting grassroots research like this, you contribute directly to the advancement of creative technology driven by unfiltered exploration and authentic discovery.
+May your journey with ShaderNoiseKSampler be one of discovery, inspiration, and creationโof digital tapestries woven from the very fabric of mathematical reality.
++ In every parameter, a doorway to creation"
+ - The Shader Matrix +