Video Composer

[tin2tin]

Model/Pipeline/Scheduler description

VideoComposer: Compositional Video Synthesis
with Motion Controllability

Open source status

• The model implementation is available
• The model weights are available (Only relevant if addition is not a scheduler).

Provide useful links for the implementation

https://videocomposer.github.io/
https://github.com/damo-vilab/videocomposer

[rishabbala]

Hi @patrickvonplaten @tin2tin I can take up this issue. Can you point me to any resource that shows which files must be changed/added?

[patrickvonplaten]

Sure does the Contribution doc help? :-)
See: https://github.com/huggingface/diffusers/blob/main/CONTRIBUTING.md

[ProgramerSalar]

it looks like this issue has been inactive for a while. I am going to pick this up and start working on the ST-UNet blocks and the conversion script!