Marigold depth estimation in ComfyUI

This is a wrapper node for Marigold depth estimation: https://github.com/prs-eth/Marigold

What I know of the parameters so far:

denoise_steps: steps per depth map, increase for accuracy in exchange of processing time

n_iters: amount of iterations to be ensembled into single depth map, increase for accuracy in exchange of processing time

invert: marigold by default produces depth map where black is front, for controlnets etc. we want the opposite

regularizer_strength, reduction_method, max_iter, tol (tolerance) are settings for the ensembling process, don't fully know how to use them yet.

It can pretty memory hungry, and slow, the original local example uses 768p as max resolution (unsure of the hugginface demo)

Installing:

Recommended way:

Use the ComfyUI manager (search for "marigold")

Manual install:

Clone this repo to ComfyUI/custom_nodes Install requirements: pip install -r requirements.txt

Get the model:

Currently using the same diffusers pipeline as in the original implementation, so in addition to the custom node, you need the model in diffusers format:

https://share.phys.ethz.ch/~pf/bingkedata/marigold/Marigold_v1_merged.tar

Either extract this archive, or do git clone https://huggingface.co/Bingxin/Marigold/ in either of these folders:

ComfyUI\custom_nodes\ComfyUI-Marigold\checkpoints or ComfyUI\models\diffusers