Update readme.md

This commit is contained in:
Jukka Seppänen
2024-12-19 14:01:13 +02:00
committed by GitHub
parent b6c1705f9f
commit 9798e3f4ec
-5
View File
@@ -4,11 +4,6 @@
# Experimental IP2V - Image Prompting to Video via VLM by @Dango233
## WORK IN PROGRESS - But it should work now!
NOTE:
- Minimum 20GB Vram required (VLM qualtization not implemented yet)
- This changes the original nodes behavior by @kijai quite a bit. So if you want to test this feature, please repoint your git to this branch and pull the updates, or simply delete the original repo and clone this one, before the PR got merged in the Kijai's repo.
Now you can feed image to the VLM as condition of generations! This is different from image2video where the image become the first frame of the video. IP2V uses image as a part of the prompt, to extract the concept and style of the image.
So - very much like IPAdapter - but VLM will do the heavy lifting for you!