From 485e2c4c51fd01b3b0019ac037665e9fa19445e7 Mon Sep 17 00:00:00 2001 From: Zuellni <123005779+Zuellni@users.noreply.github.com> Date: Sat, 25 Nov 2023 13:48:56 +0100 Subject: [PATCH] Prettify table --- README.md | 18 ++++++++++++------ 1 file changed, 12 insertions(+), 6 deletions(-) diff --git a/README.md b/README.md index bd5a46f..31fd650 100644 --- a/README.md +++ b/README.md @@ -22,12 +22,18 @@ git clone https://huggingface.co/TheBloke/zephyr-7B-beta-GPTQ -b gptq-4bit-32g-a > You can add your own `llm` path to the [extra_model_paths.yaml](https://github.com/comfyanonymous/ComfyUI/blob/master/extra_model_paths.yaml.example) file and place the models there instead. ## Nodes -Name | Description -:--- | :--- -Loader | Loads models from the `llm` directory.
`gpu_split` - comma-separated VRAM in GB per GPU, eg `6.9, 8`, if using more than one.
`cache_8bit` - lower VRAM usage but also lower speed if set to `True`.
`max_seq_len` - max context length, higher number equals higher VRAM usage. Setting it to `0` will make the model use the default context length from its config file. -Generator | Generates text based on the given prompt. Refer to [text-generation-webui](https://github.com/oobabooga/text-generation-webui/wiki/03-%E2%80%90-Parameters-Tab#parameters-description) for parameter explanations.
`unload` - unloads the model after each generation if set to `True`, freeing all the VRAM used.
`single_line` - stops generation on new line.
`max_tokens` - max new tokens to generate, setting it to `0` will make the model use all available context. -Preview | Displays generated text in the UI. -Replace | Replaces variable names enclosed in brackets, such as `[a]`, with their values. +| Node | Description | | +|:---:|---|---| +| Loader | Loads models from the `llm` directory. | | +| | `gpu_split` | Comma-separated VRAM in GB per GPU, eg `6.9, 8`. | +| | `cache_8bit` | Lower VRAM usage but also lower speed. | +| | `max_seq_len` | Max context, higher number equals higher VRAM usage. `0` will default to config. | +| Generator | Generates text based on the given prompt. Refer to [text-generation-webui](https://github.com/oobabooga/text-generation-webui/wiki/03-%E2%80%90-Parameters-Tab#parameters-description) for parameters. | | +| | `unload` | Unloads the model after each generation. | +| | `single_line` | Stops the generation on new line. | +| | `max_tokens` | Max new tokens, `0` will use available context. | +| Preview | Displays generated text in the UI. | | +| Replace | Replaces variable names enclosed in brackets, eg `[a]`, with their values. | | ## Workflow The example workflow is embedded in the image below and can be opened in ComfyUI.