AnyNode v0.1 (🍄 beta)

A ComfyUI Node that uses the power of LLMs to do anything with your input to make any type of output.

Install

Clone this repository into comfy/custom_nodes (sorry, not on Manager just yet!)
Make sure you have the openai module installed through pip: pip install openai
Add your OPENAI_API_KEY variable to your Environment Variables. How to get your OpenAI API key
Restart Comfy
In ComfyUI double-click and search for AnyNode or you can find it in Nodes > utils

How it Works

Put in what you want the node to do with the input and output.
Connect it up to anything on both sides
Hit Queue Prompt in ComfyUI

AnyNode codes a python function based on your request and whatever input you connect to it to generate the output you requested which you can then connect to compatible nodes.

Warning: Because of the ability to link ANY node, you have to make sure it nails the output.

Caveats

I have no idea how far you can take this nor it's limits
LLMs can't read your mind. To make complex stuff in one node you'd have to be great at prompting
Right now you can only see code the LLM generates in the console
Currently there is no way for it to "edit" the code but that is coming soon
You currently need an OpenAI API Key
Can't make a sandwich

Strengths

You can use as many of these as you want in your workflow creating possibly complex node groups
Uses OpenAI API for simple access to the latest and greatest in generation models
Technically you could point this at vLLM or Ollama for you LocalLLM fans

Coming Soon

Multiple Inputs and outputs
Some sort of type context map for it's coding abilities
Ability to make more complex nodes that use inputs like MODEL, VAE and CLIP with input type awareness
A more complete system prompt
Error Mitigation (You to LLM: Fix it yourself!)

2.2 KiB Raw Blame History