Files
aigc-apps-EasyAnimate/easyanimate/video_caption/utils/longclip
2024-11-08 19:46:50 +08:00
..
2024-08-21 16:40:54 +08:00
2024-11-08 19:46:50 +08:00
2024-08-21 16:40:54 +08:00
2024-08-21 16:40:54 +08:00
2024-08-21 16:40:54 +08:00

Long-CLIP

Codes in this directory are borrowed from https://github.com/beichenzbc/Long-CLIP/tree/4e6f5da/model.

We only modify the following code in model_longclip.py from

@property
def dtype(self):
    return self.visual.conv1.weight.dtype

to

@property
def dtype(self):
    # Fix: the VideoCLIP-XL inference.
    if hasattr(self, "visual"):
        return self.visual.conv1.weight.dtype
    else:
        return self.token_embedding.weight.dtype