Davids048andClaude Opus 5.5
f571621ae7
Every example calls VideoGenerator.generate with a nested request instead of generate_video keywords, and passes settings outside the from_pretrained convenience keywords through VideoGenerator.from_config at their typed paths. Each request and generator config equals what the keyword call built. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_012M91wnVFmPEvJ9h39r5BH7
48 lines
2.3 KiB
Python
48 lines
2.3 KiB
Python
# SPDX-License-Identifier: Apache-2.0
|
|
from fastvideo import VideoGenerator
|
|
|
|
|
|
def main():
|
|
# Point this to your local diffusers model dir (or replace with a HF model ID).
|
|
model_path = "KyleShao/Cosmos-Predict2.5-2B-Diffusers"
|
|
|
|
generator = VideoGenerator.from_pretrained(
|
|
model_path,
|
|
num_gpus=1,
|
|
use_fsdp_inference=False, # set True if GPU is out of memory
|
|
dit_cpu_offload=False,
|
|
vae_cpu_offload=False,
|
|
text_encoder_cpu_offload=True,
|
|
pin_cpu_memory=True,
|
|
)
|
|
|
|
# video2world example from official repo
|
|
video_path = "assets/videos/robot_pouring.mp4"
|
|
|
|
prompt = (
|
|
"A robotic arm, primarily white with black joints and cables, is shown in a clean, modern indoor setting with a white tabletop. "
|
|
"The arm, equipped with a gripper holding a small, light green pitcher, is positioned above a clear glass containing a reddish-brown liquid and a spoon. "
|
|
"The robotic arm is in the process of pouring a transparent liquid into the glass. "
|
|
"To the left of the pitcher, there is an opened jar with a similar reddish-brown substance visible through its transparent body. "
|
|
"In the background, a vase with white flowers and a brown couch are partially visible, adding to the contemporary ambiance. "
|
|
"The lighting is bright, casting soft shadows on the table. "
|
|
"The robotic arm's movements are smooth and controlled, demonstrating precision in its task. "
|
|
"As the video progresses, the robotic arm completes the pour, leaving the glass half-filled with the reddish-brown liquid. "
|
|
"The jar remains untouched throughout the sequence, and the spoon inside the glass remains stationary. "
|
|
"The other robotic arm on the right side also stays stationary throughout the video. "
|
|
"The final frame captures the robotic arm with the pitcher finishing the pour, with the glass now filled to a higher level, while the pitcher is slightly tilted but still held securely by the gripper."
|
|
)
|
|
|
|
generator.generate({
|
|
"prompt": prompt,
|
|
"inputs": {"video_path": str(video_path)},
|
|
"output": {"output_path": "outputs_video/cosmos2_5_v2w.mp4", "save_video": True},
|
|
"extensions": {"num_cond_frames": 1},
|
|
})
|
|
|
|
generator.shutdown()
|
|
|
|
|
|
if __name__ == "__main__":
|
|
main()
|