Commit Graph
11 Commits
Author SHA1 Message Date
hkz b808f604c9 Fix get_meta_file.py and autocast (#203) 2025-02-19 13:44:08 +08:00
Bubbliiiingandhkunzhe 9f34f7c8c5 Update to V5.1 (#179)
* Update Flow

* Update Flow

* Update Flow

* add image recaptioning

* Fix bug in t2v

* update train_reward_lora.py

* update reward training

* Update V5.1 and mix multi text_encoders to one pipeline

* Update V5.1 training Code

* Update ComfyUI

* Update Comment

* Delete files

* update reward training

* Update Readme

* fix extract frames in compute_semantic_consistency

* Update Readme && Remove to in prediction

* Update Demo

* Update Readme

* Update ui

* support vae gradient checkpointing in reward training

* Update Training Readme

---------

Co-authored-by: hkunzhe <huangkunzhe.hkz@alibaba-inc.com>
2025-01-22 15:30:47 +08:00
hkz 485e771acf Fix train reward lora and video caption (#165) 2024-12-10 14:23:33 +08:00
hkz 30682ba3c5 Update video caption (#129) 2024-11-13 17:43:21 +08:00
Bubbliiiing 62de94e2f1 Update V5 (#128)
Update V5
2024-11-08 19:46:50 +08:00
hkz 5ea1bf2450 Update Video Caption (#93)
* Add VILA1.5 in video caption

* update VILA1.5 in video_caption

* add get_video_path_list back & update the accelerate version & auto load the vila quant_path & download models in the main process

* add exception handling & add force_ascii=False

* fix the NCCL timeout & use logger

* update utils

* Update video splitting

* Update pre-filtering

* Update video caption

* Add caption_rewrite.py

* Add VideoCLIPXL

* Add beautiful prompt demo

* fix test

* Update Dockerfile.ds

* update VideoCLIPXL & add filter_meta_train.py

* update stage3

* update README.md

* update README_zh-CN.md

* update README

* update requirements

* fix stage_3_video_recaptioning.sh

* update Beautiful Prompt

* update README

* update vila_video_recaptioning.py & fix the empty gather result
2024-08-21 16:40:54 +08:00
hkunzhe 9e2fba7d40 fix the conflict between autogptq and sglang 2024-05-31 14:27:56 +08:00
Bubbliiiingandzouxinyi0625 fb0916f4da Update EasyAnimateV2 (#5)
* update EasyAnimateV2

* update datasets loader

* update datasets loader

* update fast api

* complete data preprocess pipeline.

* update lots of readme

* update readme bans

* fix bug in validation while training

* provide example for video cut

* update text box

* add arxiv

* delete IDDPM

* update gallery

* update arxiv

* update readme

* update readme

* link fix

* update vae readme

---------

Co-authored-by: zouxinyi0625 <zouxinyi.zxy@alibaba-inc.com>
2024-05-31 10:33:14 +08:00
hkunzhe 6efc7de3f2 add the dataset preprocessing pipeline 2024-05-27 22:26:03 +08:00
hkunzhe 728749039f revert Dockerfile.ds & add sglang runtime shutdown 2024-04-23 19:24:02 +08:00
huangkunzhe.hkz a4008a6127 add video caption 2024-04-15 16:25:11 +08:00