106 lines
4.9 KiB
Markdown
106 lines
4.9 KiB
Markdown
# Apply AnimateDiff+CameraCtrl Model 🎭🅐🅓②
|
|
## Documentation
|
|
- Class name: ADE_ApplyAnimateDiffModelWithCameraCtrl
|
|
- Category: Animate Diff 🎭🅐🅓/② Gen2 nodes ②/CameraCtrl
|
|
- Output node: False
|
|
- Repo Ref: https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved.git
|
|
|
|
此节点将AnimateDiff模型与摄像机控制相结合，集成运动模型调整和摄像机控制参数以生成动画序列。它利用摄像机控制姿势和其他动画参数来增强AnimateDiff模型的输出，提供更具动态性和可定制的动画体验。
|
|
|
|
## Input types
|
|
### Required
|
|
- motion_model
|
|
- 要进行动画处理的运动模型，结合AnimateDiff模型的功能和摄像机控制特性以增强动画。
|
|
- Comfy dtype: MOTION_MODEL_ADE
|
|
- Python dtype: MotionModelPatcher
|
|
- cameractrl_poses
|
|
- 摄像机控制姿势列表，每个姿势定义动画过程中的特定摄像机位置和方向。
|
|
- Comfy dtype: CAMERACTRL_POSES
|
|
- Python dtype: list[list[float]]
|
|
- start_percent
|
|
- 动画的起始百分比，作为总动画长度的一部分，允许实现部分动画。
|
|
- Comfy dtype: FLOAT
|
|
- Python dtype: float
|
|
- end_percent
|
|
- 动画的结束百分比，作为总动画长度的一部分，允许自定义动画的持续时间。
|
|
- Comfy dtype: FLOAT
|
|
- Python dtype: float
|
|
|
|
### Optional
|
|
- motion_lora
|
|
- 可选参数，用于指定运动LoRA设置，以进一步自定义动画。
|
|
- Comfy dtype: MOTION_LORA
|
|
- Python dtype: MotionLoraList
|
|
- scale_multival
|
|
- 可选参数，用于应用比例乘数，影响动画元素的整体大小。
|
|
- Comfy dtype: MULTIVAL
|
|
- Python dtype: dict
|
|
- effect_multival
|
|
- 可选参数，用于应用效果乘数，允许在动画中添加其他视觉效果。
|
|
- Comfy dtype: MULTIVAL
|
|
- Python dtype: dict
|
|
- cameractrl_multival
|
|
- 可选参数，用于应用多个摄像机控制值，增强动画中的动态摄像机运动。
|
|
- Comfy dtype: MULTIVAL
|
|
- Python dtype: dict
|
|
- ad_keyframes
|
|
- 可选参数，用于定义动画中的关键帧，允许对动画序列进行精确控制。
|
|
- Comfy dtype: AD_KEYFRAMES
|
|
- Python dtype: ADKeyframeGroup
|
|
- prev_m_models
|
|
- 可选参数，用于整合先前生成的运动模型，促进顺序或分层动画。
|
|
- Comfy dtype: M_MODELS
|
|
- Python dtype: MotionModelGroup
|
|
|
|
## Output types
|
|
- m_models
|
|
- Comfy dtype: M_MODELS
|
|
- 应用AnimateDiff模型和摄像机控制后生成的运动模型，包括任何指定的动画和效果。
|
|
- Python dtype: MotionModelGroup
|
|
|
|
## Usage tips
|
|
- Infra type: GPU
|
|
- Common nodes: unknown
|
|
|
|
## Source code
|
|
```python
|
|
class ApplyAnimateDiffWithCameraCtrl:
|
|
@classmethod
|
|
def INPUT_TYPES(s):
|
|
return {
|
|
"required": {
|
|
"motion_model": ("MOTION_MODEL_ADE",),
|
|
"cameractrl_poses": ("CAMERACTRL_POSES",),
|
|
"start_percent": ("FLOAT", {"default": 0.0, "min": 0.0, "max": 1.0, "step": 0.001}),
|
|
"end_percent": ("FLOAT", {"default": 1.0, "min": 0.0, "max": 1.0, "step": 0.001}),
|
|
},
|
|
"optional": {
|
|
"motion_lora": ("MOTION_LORA",),
|
|
"scale_multival": ("MULTIVAL",),
|
|
"effect_multival": ("MULTIVAL",),
|
|
"cameractrl_multival": ("MULTIVAL",),
|
|
"ad_keyframes": ("AD_KEYFRAMES",),
|
|
"prev_m_models": ("M_MODELS",),
|
|
}
|
|
}
|
|
|
|
RETURN_TYPES = ("M_MODELS",)
|
|
CATEGORY = "Animate Diff 🎭🅐🅓/② Gen2 nodes ②/CameraCtrl"
|
|
FUNCTION = "apply_motion_model"
|
|
|
|
def apply_motion_model(self, motion_model: MotionModelPatcher, cameractrl_poses: list[list[float]], start_percent: float=0.0, end_percent: float=1.0,
|
|
motion_lora: MotionLoraList=None, ad_keyframes: ADKeyframeGroup=None,
|
|
scale_multival=None, effect_multival=None, cameractrl_multival=None,
|
|
prev_m_models: MotionModelGroup=None,):
|
|
new_m_models = ApplyAnimateDiffModelNode.apply_motion_model(self, motion_model, start_percent=start_percent, end_percent=end_percent,
|
|
motion_lora=motion_lora, ad_keyframes=ad_keyframes,
|
|
scale_multival=scale_multival, effect_multival=effect_multival, prev_m_models=prev_m_models)
|
|
# most recent added model will always be first in list;
|
|
curr_model = new_m_models[0].models[0]
|
|
# confirm that model contains camera_encoder
|
|
if curr_model.model.camera_encoder is None:
|
|
raise Exception(f"Motion model '{curr_model.model.mm_info.mm_name}' does not contain a camera_encoder; cannot be used with Apply AnimateDiff-CameraCtrl Model node.")
|
|
camera_entries = [CameraEntry(entry) for entry in cameractrl_poses]
|
|
curr_model.orig_camera_entries = camera_entries
|
|
curr_model.cameractrl_multival = cameractrl_multival
|
|
return new_m_models |