These nodes can run DiLightNet, but the Dust3r or BlenderPy implementations to create lighting are not included. Expect those to be added to seperate repos when time allows.

Installation

You will need to download the DiLightNet Controlnet to your ComfyUI/models/controlnet directory.

Additionally, you will need the Stable Diffusion 2.1 model and clip text encoder.

Examples

Example workflow can be found in example_workflows

The following output is based on example inputs from the DiLightNet repo given a lighting environment that has a reddish hue.