I mainly used I2V. Used several models for the images.
Some thoughts after working on this – The acting i got from ltx blew my mind. No need for super long prompts, i just describe the overall action and put dialogue inside quotation marks.
I used the fast model mainly – with a lot of motion you sometimes get smudges, but overall worked pretty good. Some of the shots in the final video were one-shot results. i think the most difficult one was the final shot, because the guy kept entering the frame.
In general models are not good with post processing like film grain, so i’ve added some glitches and grain in post, but no color correction. The model is not super good with text, so try and avoid showing any.
You can generate 20 seconds continuous videos which is game changer for film-making (currently 20 sec available only on the fast version). Without 20 sec, i probably couldn’t get the results i wanted to make this.
Audio is pretty good, though sometimes during long silent parts it glitches.
Overall, i had tons of fun working on this. I think that this is one of the first times that i could work on something bigger than a trailer and maintain impressive realism. I can see someone who is not ‘trained’ on spotting ai thinking this is a real live-action short. Fun times ahead.
   submitted by    /u/theNivda  
 [link]   [comments]
machine learning continues to evolve faster than most can keep up with.
Recommendation systems in multi-stakeholder environments often require optimizing for multiple objectives simultaneously to meet supplier…
AI agents need to browse the web on your behalf. When your agent visits a…
The rise of AI marks a critical shift away from decades defined by information-chasing and…
I covet big animatronic skeletons for no good reason. Finally, I can justify the impulse…
New research from Carnegie Mellon University's School of Computer Science shows that the smarter the…